00000001:02000400:0.0F:1788359082.850314:0:3297:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788359108.541243:0:3519:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788359111.050163:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 517 MB/s 00000001:01000000:3.0F:1788359111.307557:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 464 MB/s 00000001:01000000:1.0:1788359111.563176:0:3582:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2611 MB/s 00000020:02000000:2.0:1788359112.690593:0:3611:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.56_1_g896c54c 00000400:02000000:0.0:1788359113.981263:0:3626:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.152@tcp [8/256/0/180] 00008000:02000000:3.0:1788359117.588366:0:3776:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788359175.271776:0:5742:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788359188.640155:0:6492:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788359188.640164:0:6492:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788359188.640165:0:6492:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788359188.642901:0:6492:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000fcf33ecf 00000080:02000400:2.0:1788359188.642932:0:6492:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788359188.669332:0:6492:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788359188.669346:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359188.673475:0:6492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000027f0e879) 00000020:00000080:3.0:1788359188.673526:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788359188.764137:0:6492:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788359188.764250:0:6492:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788359188.822227:0:6492:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788359188.823210:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788359188.823236:0:6492:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788359188.823250:0:6492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feadf7c 00000020:01000004:0.0:1788359188.823258:0:6492:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788359188.823263:0:6492:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788359188.823268:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fcf33ecf from MGS 00000020:01000004:0.0:1788359188.823272:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788359188.823294:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000faed014) 00000020:00000080:0.0:1788359188.823306:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788359188.823677:0:6492:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fcf33ecf from MGS, refs=2 00080000:01000000:0.0:1788359188.823684:0:6492:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788359188.823690:0:6492:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feadf8a 00000100:00100000:0.0:1788359188.823792:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788359188.824680:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788359188.824688:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788359188.825629:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788359188.825640:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788359188.826435:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359188.826632:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788359188.826639:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788359188.827906:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788359188.827927:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788359188.828398:0:6492:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788359188.828410:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788359188.829892:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359188.829901:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359188.829903:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359188.830455:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359188.830459:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359188.830461:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359188.831327:0:6492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788359188.834091:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788359189.081340:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2575 MB/s 00000001:01000000:3.0:1788359189.330692:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3855 MB/s 00000001:01000000:2.0:1788359189.580565:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 475 MB/s 00000001:01000000:1.0:1788359189.831157:0:6492:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 783 MB/s 00080000:10000000:0.0:1788359189.840545:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788359189.859740:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788359189.870018:0:6507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788359189.870235:0:6492:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788359189.870434:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788359189.871992:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788359189.872056:0:6492:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788359189.878194:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359189.878758:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788359189.878768:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788359189.879966:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788359189.879977:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788359189.883624:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788359189.883640:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788359189.886693:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788359189.886729:0:6492:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.152@tcp' 00000020:01000004:0.0:1788359189.886731:0:6492:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788359189.886789:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.152@tcp (typ=mgc) 00000020:00000080:0.0:1788359189.886807:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.152@tcp (0000000039d67ba2) 00000020:00000080:0.0:1788359189.886833:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788359189.886958:0:6492:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007bfeb1cb@MGC192.168.202.152@tcp: add connection 192.168.202.152@tcp at head 00010000:00010000:0.0:1788359189.887148:0:6492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.152@tcp-0 is initialized 00000040:01000000:0.0:1788359189.887156:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788359189.887564:0:6511:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788359189.888879:0:6512:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788359189.888943:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.152@tcp (uuid 8a40c955-5ca1-4b36-8930-3bb8957fb20c) 00000020:00000080:2.0:1788359189.888969:0:6492:0:(genops.c:1406:class_connect()) connect: client 8a40c955-5ca1-4b36-8930-3bb8957fb20c, cookie 0x49dd053b5feadf98 00000100:00080000:2.0:1788359189.888984:0:6492:0:(import.c:510:import_select_connection()) MGC192.168.202.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788359189.888990:0:6492:0:(import.c:624:import_select_connection()) MGC192.168.202.152@tcp: import 000000007bfeb1cb using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359189.889051:0:6492:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fca222e9 x1875230445273216/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359189.889086:0:6492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS 00000020:01000004:2.0:1788359189.889108:0:6492:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788359189.889114:0:6492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788359189.889138:0:6492:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000015831b4c) 00000020:00000080:2.0:1788359189.889151:0:6492:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788359189.893966:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fca222e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445273216:0@lo:250: 00000100:00100000:3.0:1788359189.894141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359189.897333:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273216 00000100:00100000:0.0:1788359189.897354:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273216 00010000:00010000:2.0:1788359189.897450:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359189.897972:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359189.897984:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4d0c53d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1875230445273216:12345-0@lo:250: 00010000:00080000:0.0:1788359189.898053:0:6508:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8a40c955-5ca1-4b36-8930-3bb8957fb20c@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:0.0:1788359189.898318:0:6508:0:(genops.c:1406:class_connect()) connect: client 8a40c955-5ca1-4b36-8930-3bb8957fb20c, cookie 0x49dd053b5feadfa6 00000100:00080000:0.0:1788359189.898606:0:6508:0:(import.c:65:import_set_state_nolock()) 0000000079d1f786 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359189.898751:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4d0c53d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:3641:x1875230445273216:12345-0@lo:250: Request processed in 767us (4610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359189.898762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359189.898772:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788359189.898785:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.202.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1788359189.898796:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.202.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788359189.898803:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788359189.898807:0:3641:0:(import.c:65:import_set_state_nolock()) 000000007bfeb1cb MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788359189.898810:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788359189.898824:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788359189.898830:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fca222e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445273216:0@lo:250: 00000100:00100000:3.0:1788359189.919937:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359189.920224:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788359189.920232:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788359189.922918:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788359189.922943:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788359189.923908:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788359189.923918:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788359189.924928:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359189.925131:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788359189.925137:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788359189.926666:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788359189.926681:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788359189.981392:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359189.981660:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788359189.981668:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788359189.985864:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788359189.985879:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788359189.986961:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788359189.987208:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788359189.987213:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788359189.992761:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788359189.992845:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788359189.995854:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359189.996810:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788359189.996817:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788359189.997441:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788359189.997451:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788359189.998325:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359189.998472:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788359189.998476:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788359189.999065:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788359189.999071:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788359190.025314:0:6492:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359190.025533:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788359190.025541:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788359190.026806:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788359190.026814:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788359190.027484:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788359190.027492:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788359190.028544:0:6492:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788359190.028575:0:6492:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788359190.028582:0:6492:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788359190.028686:0:6492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788359190.028720:0:6492:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.152@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788359190.028724:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788359190.028726:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788359190.028728:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359190.028729:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359190.028730:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359190.028731:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359190.028733:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359190.028747:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788359190.028749:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788359190.028750:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788359190.028751:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359190.028752:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359190.028755:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788359190.028757:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788359190.028759:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788359190.028760:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359190.028761:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359190.028762:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359190.028763:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359190.028769:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359190.028770:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788359190.028771:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788359190.028771:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788359190.028772:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359190.028773:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359190.028815:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788359190.028833:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e606da8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273344:0@lo:253: 00000100:00100000:1.0:1788359190.028939:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359190.028994:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 0000000056608b3a going to sleep for 11 seconds 00000100:00100000:0.0:1788359190.029080:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273344 00000100:00100000:0.0:1788359190.029090:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273344 00000100:00100000:0.0:1788359190.029138:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359190.029145:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015ac6dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:6492:x1875230445273344:12345-0@lo:253: 20000000:01000000:0.0:1788359190.029193:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788359190.029196:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788359190.030196:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788359190.030306:0:6510:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788359190.030626:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359190.031682:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788359190.031825:0:6510:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788359190.031829:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788359190.031834:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788359190.031837:0:6510:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788359190.031976:0:6510:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788359190.032151:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359190.032328:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788359190.032344:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788359190.032361:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788359190.032377:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788359190.032392:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788359190.032442:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788359190.032452:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788359190.032466:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788359190.032473:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788359190.032487:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788359190.032526:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788359190.032546:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788359190.032566:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788359190.032600:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788359190.032606:0:6510:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788359190.032616:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359190.032718:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788359190.032730:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788359190.032745:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788359190.032760:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788359190.032775:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788359190.032784:0:6510:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788359190.032806:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788359190.032813:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788359190.032824:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788359190.033145:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788359190.033166:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788359190.033176:0:6510:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788359190.033202:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788359190.033210:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788359190.033224:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788359190.033239:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788359190.033293:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788359190.033315:0:6510:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788359190.033321:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788359190.033704:0:6533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788359190.033962:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788359190.033982:0:6510:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.152@tcp for mdt 20000000:01000000:0.0:1788359190.033985:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788359190.034001:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788359190.034007:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788359190.034031:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788359190.034038:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:0.0:1788359190.034052:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788359190.034060:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788359190.034072:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788359190.034087:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788359190.034128:0:6510:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788359190.034132:0:6510:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788359190.034136:0:6510:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788359190.034177:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788359190.034178:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788359190.034478:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788359190.034669:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788359190.034692:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788359190.034707:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788359190.034718:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788359190.034719:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788359190.038906:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788359190.039257:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788359190.039295:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788359190.039312:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788359190.039328:0:6510:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359190.039331:0:6510:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788359190.039337:0:6510:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788359190.039339:0:6510:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788359190.039353:0:6510:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788359190.039360:0:6510:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788359190.039913:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788359190.040042:0:6510:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788359190.056676:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788359190.056716:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788359190.056731:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788359190.056752:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788359190.056779:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056797:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056811:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056836:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056842:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056847:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056854:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a7c1978d already unused, calling callback (00000000117919a9) 00010000:00010000:0.0:1788359190.056857:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056864:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056877:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056883:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.056888:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788359190.056908:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788359190.071216:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015ac6dca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:6492:x1875230445273344:12345-0@lo:253: Request processed in 42063us (42269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359190.071232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359190.071380:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e606da8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273344:0@lo:253: 10000000:01000000:1.0:1788359190.071398:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788359190.071402:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788359190.071404:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788359190.071405:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359190.071406:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788359190.071407:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359190.071409:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359190.071410:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359190.071411:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788359190.071412:0:6492:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788359190.071414:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359190.071416:0:6492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788359190.071439:0:6492:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fcf33ecf from lustre-MDT0000 10000000:01000000:1.0:1788359190.071471:0:6492:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788359190.071474:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788359190.071478:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0eaf5930000 10000000:01000000:1.0:1788359190.071482:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359190.071491:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0eaf5930000 from 1 10000000:01000000:1.0:1788359190.071632:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788359190.071684:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.071696:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.071705:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359190.071723:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e606da8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273472:0@lo:101: 00000100:00100000:1.0:1788359190.071785:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359190.071845:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dc7c0fd going to sleep for 11 seconds 00000100:00100000:0.0:1788359190.071911:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273472 00000100:00100000:0.0:1788359190.071938:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273472 00000100:00100000:0.0:1788359190.071990:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359190.071999:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000636e3d1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:6492:x1875230445273472:12345-0@lo:101: 00010000:00010000:0.0:1788359190.072122:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359190.072137:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feadfb4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.072162:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.072171:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.072180:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a7c1978d, rc 0) 00000100:00100000:0.0:1788359190.072222:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000636e3d1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:6492:x1875230445273472:12345-0@lo:101: Request processed in 225us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359190.072229:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359190.072391:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e606da8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273472:0@lo:101: 00010000:00010000:2.0:1788359190.072407:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.072418:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359190.072480:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000a604be1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273600:0@lo:501: 00000100:00100000:3.0:1788359190.074326:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.074380:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 00000000767589ac going to sleep for 11 seconds 00000100:00100000:0.0:1788359190.075237:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273600 00000100:00100000:0.0:1788359190.075250:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273600 00000100:00100000:0.0:1788359190.075315:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359190.075324:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ddfcf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:6492:x1875230445273600:12345-0@lo:501: 00000100:00100000:0.0:1788359190.075444:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ddfcf0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:6492:x1875230445273600:12345-0@lo:501: Request processed in 121us (1123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359190.075452:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359190.076675:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000a604be1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273600:0@lo:501: 10000000:01000000:3.0:1788359190.076724:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788359190.076751:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.076763:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359190.076773:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eae4e42000 10000000:01000000:3.0:1788359190.076780:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788359190.076787:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0eae4e42000 10000000:01000000:3.0:1788359190.076790:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788359190.076793:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0eae4e42000 from 1 10000000:01000000:3.0:1788359190.076796:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788359190.076867:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.076875:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.076885:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.076917:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273728:0@lo:101: 00000100:00100000:3.0:1788359190.076974:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.077034:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000004842be1a going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.077268:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273728 00000100:00100000:2.0:1788359190.077275:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273728 00000100:00100000:2.0:1788359190.077316:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359190.077324:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c411181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:6492:x1875230445273728:12345-0@lo:101: 00010000:00010000:2.0:1788359190.077338:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359190.077352:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b682a331/0x49dd053b5feadfc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feadfc2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.077391:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b682a331/0x49dd053b5feadfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feadfc2 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.077402:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b682a331/0x49dd053b5feadfc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feadfc2 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.077410:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b682a331, rc 0) 00000100:00100000:2.0:1788359190.077454:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c411181 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+7:6492:x1875230445273728:12345-0@lo:101: Request processed in 130us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.077461:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788359190.078622:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273728:0@lo:101: 00010000:00010000:3.0:1788359190.078649:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.078660:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359190.078677:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788359190.078699:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.078706:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000949fe1b6/0x49dd053b5feadfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359190.078713:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788359190.078719:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788359190.078726:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0eae4e42000 10000000:01000000:3.0:1788359190.078728:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788359190.078737:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788359190.078739:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788359190.078766:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.078773:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.078799:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.078817:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273856:0@lo:101: 00000100:00100000:3.0:1788359190.078890:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.078941:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000004842be1a going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.079165:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273856 00000100:00100000:1.0:1788359190.079174:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273856 00000100:00100000:1.0:1788359190.079246:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359190.079256:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ee4088e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+7:6492:x1875230445273856:12345-0@lo:101: 00010000:00010000:1.0:1788359190.079273:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359190.079286:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feadfd0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.079307:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.079316:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 8 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.079324:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e4e5f40, rc 0) 00000100:00100000:1.0:1788359190.079368:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ee4088e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+8:6492:x1875230445273856:12345-0@lo:101: Request processed in 115us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.079375:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788359190.080575:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273856:0@lo:101: 00010000:00010000:3.0:1788359190.080603:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.080614:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.080693:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273984:0@lo:501: 00000100:00100000:3.0:1788359190.080744:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.080790:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000004842be1a going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.081354:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445273984 00000100:00100000:1.0:1788359190.081363:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445273984 00000100:00100000:1.0:1788359190.081410:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359190.081418:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036ab9af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+8:6492:x1875230445273984:12345-0@lo:501: 00000100:00100000:1.0:1788359190.081626:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036ab9af9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6492:x1875230445273984:12345-0@lo:501: Request processed in 208us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.081633:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359190.081818:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445273984:0@lo:501: 00000100:00100000:3.0:1788359190.081867:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274112:0@lo:503: 00000100:00100000:3.0:1788359190.081922:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.081962:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000004842be1a going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.082031:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274112 00000100:00100000:1.0:1788359190.082037:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274112 00000100:00100000:1.0:1788359190.082084:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788359190.082091:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065268230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6492:x1875230445274112:12345-0@lo:503: 00000100:00100000:1.0:1788359190.082210:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065268230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6492:x1875230445274112:12345-0@lo:503: Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.082217:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788359190.082716:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274112:0@lo:503: 00000100:00100000:3.0:1788359190.083230:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6537:1875230445274240:0@lo:502: 00000100:00100000:3.0:1788359190.083280:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.083315:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b21d978a going to sleep for 11 seconds 00000100:00100000:0.0:1788359190.083369:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274240 00000100:00100000:0.0:1788359190.083375:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274240 00000100:00100000:0.0:1788359190.083418:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359190.083426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2ca081d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6537:x1875230445274240:12345-0@lo:502: 00000100:00100000:0.0:1788359190.083562:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2ca081d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6537:x1875230445274240:12345-0@lo:502: Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359190.083575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788359190.084738:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6537:1875230445274240:0@lo:502: 00000020:01000000:3.0:1788359190.084789:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359190.084802:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359190.084805:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788359190.084810:0:6537:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788359190.084813:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359190.084829:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000090e4110f) 00000020:00000080:3.0:1788359190.084874:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788359190.084882:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788359190.084984:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788359190.084992:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feadfe5 00000020:00000080:3.0:1788359190.085258:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788359190.085263:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359190.085267:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359190.085268:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788359190.085271:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359190.085274:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359190.085275:0:6537:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788359190.085279:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359190.085286:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000001150132) 00000020:00000080:3.0:1788359190.085297:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788359190.085301:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788359190.085303:0:6537:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788359190.085306:0:6537:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788359190.085313:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788359190.085392:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fcf33ecf from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788359190.085407:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b3cfc659) 00000020:00000080:3.0:1788359190.085415:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788359190.085472:0:6537:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788359190.085477:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feadffa 00000020:00000080:3.0:1788359190.086036:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788359190.086044:0:6537:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788359190.086052:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x49dd053b5feae001 00080000:01000000:3.0:1788359190.086058:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788359190.086072:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feae008 00080000:10000000:3.0:1788359190.090603:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788359190.090953:0:6537:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788359190.105112:0:6537:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788359190.280676:0:6537:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788359190.281083:0:6537:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788359190.284708:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788359190.289165:0:6537:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788359190.292225:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000125291d) 00000020:00000080:0.0:1788359190.292253:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788359190.292355:0:6537:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788359190.292363:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feae016 00000020:00000080:0.0:1788359190.292892:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788359190.294093:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788359190.297562:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788359190.300161:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788359190.323325:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788359190.327476:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788359190.331734:0:6537:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788359190.342349:0:6537:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x49dd053b5feae01d 00000020:00000080:0.0:1788359190.343376:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788359190.343389:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359190.343397:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359190.343399:0:6537:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788359190.343402:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359190.343407:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359190.343408:0:6537:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788359190.343411:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788359190.343413:0:6537:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788359190.343415:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359190.343418:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359190.343419:0:6537:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788359190.343421:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359190.343427:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359190.343428:0:6537:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788359190.343433:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788359190.343480:0:6537:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788359190.344444:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a560c5d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6537:1875230445274368:0@lo:502: 00000100:00100000:0.0:1788359190.344882:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.345004:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cc40fc64 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.345125:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274368 00000100:00100000:2.0:1788359190.345137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274368 00000100:00100000:2.0:1788359190.345240:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359190.345251:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df832d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6537:x1875230445274368:12345-0@lo:502: 00000100:00100000:2.0:1788359190.345436:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df832d75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6537:x1875230445274368:12345-0@lo:502: Request processed in 187us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.345444:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359190.345727:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a560c5d4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6537:1875230445274368:0@lo:502: 00000020:01000000:1.0:1788359190.345762:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359190.345770:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359190.345772:0:6537:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788359190.345777:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788359190.348183:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788359190.348233:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788359190.348260:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.348276:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359190.348286:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eae4e42000 from 1 10000000:01000000:3.0:1788359190.348289:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359190.348345:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.348352:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.348362:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.348388:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274496:0@lo:101: 00000100:00100000:3.0:1788359190.348471:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.350076:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aaa5d10 going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.350211:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274496 00000100:00100000:1.0:1788359190.350220:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274496 00000100:00100000:1.0:1788359190.350277:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788359190.350287:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b7cfbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:6492:x1875230445274496:12345-0@lo:101: 00010000:00010000:1.0:1788359190.350305:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359190.350325:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae024 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.350358:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae024 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.350369:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae024 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.350379:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad876d49, rc 0) 00000100:00100000:1.0:1788359190.350463:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b7cfbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:6492:x1875230445274496:12345-0@lo:101: Request processed in 178us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.350471:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788359190.350926:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274496:0@lo:101: 00010000:00010000:3.0:1788359190.350948:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.350956:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.351449:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274624:0@lo:256: 00000100:00100000:3.0:1788359190.351782:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.351869:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aaa5d10 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.351964:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274624 00000100:00100000:2.0:1788359190.351972:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274624 00000100:00100000:2.0:1788359190.352054:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359190.352062:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000519db42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:6492:x1875230445274624:12345-0@lo:256: 20000000:01000000:2.0:1788359190.352083:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788359190.352088:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788359190.352162:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000519db42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:6492:x1875230445274624:12345-0@lo:256: Request processed in 101us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.352169:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359190.352246:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274624:0@lo:256: 10000000:01000000:3.0:1788359190.352801:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359190.352827:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.352846:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359190.352855:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eae4e42000 from 1 10000000:01000000:3.0:1788359190.352858:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359190.352889:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.352896:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.352905:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.352931:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274752:0@lo:101: 00000100:00100000:3.0:1788359190.352965:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.353269:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aaa5d10 going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.353414:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274752 00000100:00100000:1.0:1788359190.353423:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274752 00000100:00100000:1.0:1788359190.353456:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359190.353462:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b4e35c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:6492:x1875230445274752:12345-0@lo:101: 00010000:00010000:1.0:1788359190.353475:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359190.353491:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae032 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.353549:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae032 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.353560:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae032 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.353570:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062377ec9, rc 0) 00000100:00100000:1.0:1788359190.353613:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b4e35c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445274752:12345-0@lo:101: Request processed in 151us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359190.353778:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274752:0@lo:101: 00010000:00010000:3.0:1788359190.353793:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.353801:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.353875:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274880:0@lo:501: 00000100:00100000:3.0:1788359190.353903:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.353919:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aaa5d10 going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.354010:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359190.354050:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445274880 00000100:00100000:1.0:1788359190.354054:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445274880 00000100:00100000:1.0:1788359190.354068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788359190.354072:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054ae4a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445274880:12345-0@lo:501: 00000100:00100000:1.0:1788359190.354314:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054ae4a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445274880:12345-0@lo:501: Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.354321:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788359190.354623:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445274880:0@lo:501: 00000100:00100000:3.0:1788359190.354778:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275008:0@lo:503: 00000100:00100000:3.0:1788359190.354825:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359190.354941:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001aaa5d10 going to sleep for 11 seconds 00000100:00100000:1.0:1788359190.354977:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275008 00000100:00100000:1.0:1788359190.354989:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275008 00000100:00100000:1.0:1788359190.355060:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788359190.355067:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008404b772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445275008:12345-0@lo:503: 00000040:00080000:1.0:1788359190.355101:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359190.355145:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008404b772 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445275008:12345-0@lo:503: Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359190.355152:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359190.355216:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275008:0@lo:503: 00000040:00080000:3.0:1788359190.356245:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788359190.356465:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788359190.356522:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359190.356540:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.356552:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359190.356603:0:6492:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788359190.356606:0:6492:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eae4e42000 10000000:01000000:0.0:1788359190.356610:0:6492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eae4e42000 10000000:01000000:0.0:1788359190.356614:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359190.356620:0:6492:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eae4e42000 from 1 10000000:01000000:0.0:1788359190.356631:0:6492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359190.356679:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.356687:0:6492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.356695:0:6492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359190.356712:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275136:0@lo:101: 00000100:00100000:0.0:1788359190.356760:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.357227:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ee96b55 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.357302:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275136 00000100:00100000:2.0:1788359190.357318:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275136 00000100:00100000:2.0:1788359190.357350:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788359190.357357:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb41086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6492:x1875230445275136:12345-0@lo:101: 00010000:00010000:2.0:1788359190.357368:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359190.357380:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae040 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.357399:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.357408:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.357415:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013743d4b, rc 0) 00000100:00100000:2.0:1788359190.357456:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb41086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275136:12345-0@lo:101: Request processed in 100us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.357463:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359190.357578:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275136:0@lo:101: 00010000:00010000:0.0:1788359190.357593:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.357601:0:6492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359190.357776:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275264:0@lo:501: 00000100:00100000:0.0:1788359190.357804:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.357829:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ee96b55 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.357933:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275264 00000100:00100000:2.0:1788359190.357938:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275264 00000100:00100000:2.0:1788359190.357955:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359190.357960:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f2c208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275264:12345-0@lo:501: 00000100:00100000:2.0:1788359190.358091:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f2c208 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275264:12345-0@lo:501: Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.358097:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788359190.358169:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275264:0@lo:501: 00000100:00100000:0.0:1788359190.358208:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275392:0@lo:503: 00000100:00100000:0.0:1788359190.358247:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.358269:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ee96b55 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.358316:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275392 00000100:00100000:2.0:1788359190.358320:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275392 00000100:00100000:2.0:1788359190.358335:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359190.358339:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013f04482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275392:12345-0@lo:503: 00000100:00100000:2.0:1788359190.358425:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013f04482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275392:12345-0@lo:503: Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.358439:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788359190.358540:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275392:0@lo:503: 00000100:00100000:0.0:1788359190.359355:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6542:1875230445275520:0@lo:502: 00000100:00100000:0.0:1788359190.359428:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.359482:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 00000000858fdf37 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.359581:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275520 00000100:00100000:2.0:1788359190.359592:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275520 00000100:00100000:2.0:1788359190.359641:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359190.359652:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa87e61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6542:x1875230445275520:12345-0@lo:502: 00000100:00100000:2.0:1788359190.359845:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa87e61e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6542:x1875230445275520:12345-0@lo:502: Request processed in 184us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.359855:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359190.360161:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6542:1875230445275520:0@lo:502: 00000020:01000004:0.0:1788359190.360248:0:6542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788359190.360269:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007f494720) 00000020:00000080:0.0:1788359190.360297:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788359190.360611:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fcf33ecf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788359190.360616:0:6542:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fcf33ecf from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788359190.360619:0:6542:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fcf33ecf 4 00010000:00080000:0.0:1788359190.360695:0:6542:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000009022794@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:0.0:1788359190.367192:0:6542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788359190.367365:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788359190.367432:0:6542:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788359190.367454:0:6542:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x49dd053b5feae055 00000100:00080000:0.0:1788359190.367471:0:6542:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788359190.367479:0:6542:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009022794 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359190.367571:0:6542:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005c090631 x1875230445275648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788359190.367607:0:6542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788359190.367827:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445275648:0@lo:38: 00000100:00100000:2.0:1788359190.367903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.369985:0:6542:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000014df000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6542:1875230445275776:0@lo:502: 00000100:00100000:0.0:1788359190.370071:0:6542:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359190.370115:0:6542:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e72a917 going to sleep for 11 seconds 00000100:00100000:2.0:1788359190.370324:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275776 00000100:00100000:2.0:1788359190.370333:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275776 00000100:00100000:2.0:1788359190.370390:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788359190.370402:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e36f112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6542:x1875230445275776:12345-0@lo:502: 00000100:00100000:2.0:1788359190.370576:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e36f112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6542:x1875230445275776:12345-0@lo:502: Request processed in 176us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359190.370584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359190.372855:0:6542:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000014df000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6542:1875230445275776:0@lo:502: 00000040:00080000:0.0:1788359190.372910:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788359190.373094:0:6492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788359190.373116:0:6492:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359190.373138:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.373148:0:6492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788359190.373199:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788359190.373202:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788359190.373208:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359190.373209:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359190.373210:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359190.373211:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359190.373212:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359190.373213:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788359190.373215:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359190.373216:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359190.373217:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359190.373218:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359190.373222:0:6492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788359190.373224:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359190.373225:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788359190.373226:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359190.373227:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359190.373227:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359190.373228:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359190.373229:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359190.373230:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788359190.373231:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359190.373232:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359190.373232:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359190.373233:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359190.373258:0:6492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788359190.373274:0:6492:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000845a2903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275904:0@lo:253: 00000100:00100000:2.0:1788359190.373327:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359190.373355:0:6492:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c64bdac0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359190.373467:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275904 00000100:00100000:3.0:1788359190.373475:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275904 00000100:00100000:0.0:1788359190.373548:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445275648 00000100:00100000:0.0:1788359190.373553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445275648 00000100:00100000:0.0:1788359190.373583:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359190.373588:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094726e69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445275648:12345-0@lo:38: 00000100:00100000:0.0:1788359190.373661:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094726e69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445275648:12345-0@lo:38: Request processed in 70us (5758us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788359190.373772:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359190.373809:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359190.373817:0:3641:0:(import.c:65:import_set_state_nolock()) 0000000009022794 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359190.373821:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788359190.373824:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005c090631 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445275648:0@lo:38: 00000100:00100000:3.0:1788359190.373933:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788359190.373940:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e301a731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275904:12345-0@lo:253: 20000000:01000000:3.0:1788359190.373966:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788359190.373980:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788359190.380196:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788359190.380224:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788359190.380281:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788359190.380286:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788359190.380312:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.380334:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.380343:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.380389:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.380405:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359190.380421:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445276032:0@lo:104: 00000100:00100000:1.0:1788359190.380535:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359190.380603:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037e86158 going to sleep for 11 seconds 00000100:00100000:3.0:1788359190.380817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e301a731 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6492:x1875230445275904:12345-0@lo:253: Request processed in 6877us (7488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359190.380828:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359190.380971:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276032 00000100:00100000:0.0:1788359190.380992:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276032 00000100:00100000:0.0:1788359190.381052:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359190.381060:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087382855 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445276032:12345-0@lo:104: 00010000:00010000:0.0:1788359190.381074:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359190.381130:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359190.381149:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087382855 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445276032:12345-0@lo:104: Request processed in 91us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359190.381156:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359190.381322:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445276032:0@lo:104: 00010000:00010000:1.0:1788359190.381344:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.381490:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359190.381530:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.381539:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069d1fdd9 already unused, calling callback (00000000e798e4a8) 10000000:00010000:2.0:1788359190.381542:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.381550:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359190.381567:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359190.381575:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788359190.381613:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.381620:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359190.381655:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359190.381820:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000806b7819 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445276160:0@lo:103: 00010000:00010000:2.0:1788359190.381886:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 0000000069d1fdd9/0x49dd053b5feae024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae02b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359190.381906:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359190.381908:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359190.381910:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359190.381933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359190.381934:0:6492:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000845a2903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6492:1875230445275904:0@lo:253: 10000000:01000000:2.0:1788359190.381947:0:6492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788359190.381951:0:6492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788359190.381953:0:6492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788359190.381954:0:6492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359190.381955:0:6492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359190.381956:0:6492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359190.381957:0:6492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359190.381958:0:6492:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359190.381960:0:6492:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788359190.381961:0:6492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359190.381963:0:6492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359190.381964:0:6492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359190.381966:0:6492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788359190.381979:0:6492:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788359190.382777:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276160 00000100:00100000:3.0:1788359190.382786:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276160 00010000:00010000:3.0:1788359190.382811:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.382849:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359190.382856:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d101c054 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3643:x1875230445276160:12345-0@lo:103: 00010000:00010000:3.0:1788359190.382869:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359190.382873:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382885:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382900:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad876d49/0x49dd053b5feae02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae024 expref: 12 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382917:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382925:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788359190.382942:0:6500:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002655894s 00010000:00010000:3.0:1788359190.382946:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382965:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382972:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382978:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382984:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db1f80b0 already unused, calling callback (00000000117919a9) 00010000:00010000:3.0:1788359190.382987:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.382994:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.383014:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359190.383035:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359190.383049:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.383056:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359190.383061:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae05c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359190.383092:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d101c054 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:3643:x1875230445276160:12345-0@lo:103: Request processed in 237us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359190.383100:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359190.383133:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000806b7819 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445276160:0@lo:103: 00080000:10000000:2.0:1788359190.388295:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788359190.388448:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788359190.388715:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788359190.388911:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788359190.389138:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788359190.389295:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788359190.393241:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788359190.393415:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788359190.394601:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788359190.394907:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788359190.395107:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788359190.395262:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788359190.404393:0:6492:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788359190.420109:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788359190.420197:0:6547:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788359190.420202:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788359190.426895:0:6548:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:0.0:1788359190.438591:0:6548:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788359190.443441:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788359190.445431:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788359190.447182:0:6492:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788359190.447200:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788359190.447392:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359190.451007:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788359190.453040:0:6492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788359190.453119:0:6492:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788359190.453202:0:6548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788359190.453287:0:6548:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788359190.453292:0:6548:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788359190.453386:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788359190.455269:0:6492:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788359190.459246:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788359190.459451:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788359190.461093:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788359190.461271:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788359190.461403:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788359190.461574:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788359190.462092:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788359190.462225:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788359190.462374:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788359190.466444:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788359190.467086:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788359190.467226:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788359190.467364:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788359190.467486:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788359190.468235:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788359190.468381:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788359190.468976:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788359190.469143:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788359190.469290:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788359190.469430:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788359190.474972:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788359190.475291:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788359190.475423:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788359190.477810:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788359190.478032:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788359190.478218:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788359190.478357:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788359190.478488:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788359190.479074:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788359190.479228:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788359190.479357:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788359190.479478:0:6492:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788359190.479981:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788359190.496456:0:6492:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788359190.496520:0:6492:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb78b4182f988 00100000:10000000:1.0:1788359190.496529:0:6492:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788359190.497457:0:6492:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788359190.497475:0:6492:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788359190.497626:0:6492:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788359190.497652:0:6492:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788359190.499358:0:6492:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359190.499631:0:6492:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788359190.909059:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359191.933121:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359192.960894:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359193.980685:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788359194.954256:0:6793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788359195.013286:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788359195.607316:0:6845:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359195.607485:0:6845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788359195.837720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788359195.837733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788359195.837736:0:37:0:(import.c:65:import_set_state_nolock()) 0000000009022794 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359195.837752:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009022794 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359195.837777:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c1cee608 x1875230445276416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359195.837909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359195.837926:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445276288:0@lo:400: 00000100:00100000:2.0:1788359195.838008:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359195.838110:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276288 00000100:00100000:3.0:1788359195.838120:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276288 00000100:00100000:3.0:1788359195.838177:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359195.838186:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e685380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:3645:x1875230445276288:12345-0@lo:400: 00000100:00100000:3.0:1788359195.838244:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e685380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:3645:x1875230445276288:12345-0@lo:400: Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359195.838251:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359195.838312:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445276288:0@lo:400: 00000100:00100000:0.0:1788359195.838809:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c1cee608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445276416:0@lo:38: 00000100:00100000:0.0:1788359195.838850:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359195.841366:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276416 00000100:00100000:3.0:1788359195.841386:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276416 00000100:00100000:3.0:1788359195.841428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359195.841435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c090631 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875230445276416:12345-0@lo:38: 00010000:00080000:3.0:1788359195.841475:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788359195.841597:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x49dd053b5feae063 00000004:00100000:3.0:1788359195.841646:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788359195.841759:0:6517:0:(import.c:65:import_set_state_nolock()) 000000006193f343 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359195.841852:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c090631 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875230445276416:12345-0@lo:38: Request processed in 416us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359195.841860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788359195.842049:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c1cee608 x1875230445276416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359195.842066:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788359195.842073:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788359195.842078:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788359195.842080:0:3641:0:(import.c:65:import_set_state_nolock()) 0000000009022794 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359195.842085:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c1cee608 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445276416:0@lo:38: 00010000:00010000:0.0:1788359196.029879:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359197.053663:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359198.076696:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359198.118475:0:6946:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359198.120142:0:6946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788359198.911593:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788359198.911602:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eae4e42000 from 3 10000000:01000000:3.0:1788359198.911609:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359198.911655:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.911669:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.911680:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359198.911705:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445276544:0@lo:101: 00000100:00100000:3.0:1788359198.911789:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359198.911853:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa7728be going to sleep for 11 seconds 00000100:00100000:3.0:1788359198.911874:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276544 00000100:00100000:3.0:1788359198.911881:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276544 00000100:00100000:3.0:1788359198.911927:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359198.911947:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0fb788a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6512:x1875230445276544:12345-0@lo:101: 00010000:00010000:3.0:1788359198.911961:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359198.911974:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae06a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.911997:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae06a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.912007:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae06a expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.912017:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ce68b17, rc 0) 00000100:00100000:3.0:1788359198.912055:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0fb788a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445276544:12345-0@lo:101: Request processed in 121us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359198.912062:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359198.912113:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445276544:0@lo:101: 00010000:00010000:3.0:1788359198.912126:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359198.912135:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359198.912196:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445276672:0@lo:256: 00000100:00100000:3.0:1788359198.912229:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359198.912248:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fa7728be going to sleep for 11 seconds 00000100:00100000:2.0:1788359198.912261:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276672 00000100:00100000:2.0:1788359198.912267:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276672 00000100:00100000:2.0:1788359198.912301:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359198.912306:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7571ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445276672:12345-0@lo:256: 20000000:01000000:2.0:1788359198.912321:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788359198.912336:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788359198.912339:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788359198.912408:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7571ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445276672:12345-0@lo:256: Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359198.912415:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359198.912447:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000088b838c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445276672:0@lo:256: 10000000:01000000:2.0:1788359198.912512:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359198.912519:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359198.912528:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359199.100890:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359200.124838:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359200.957110:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359200.957139:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000013385fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445276928:0@lo:400: 00000100:00100000:1.0:1788359200.957224:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359200.957464:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359200.957476:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000016160bbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445276800:0@lo:400: 00000100:00100000:2.0:1788359200.957541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359200.957607:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276928 00000100:00100000:2.0:1788359200.957615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276928 00000100:00100000:2.0:1788359200.957667:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359200.957674:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce974d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445276928:12345-0@lo:400: 00000100:00100000:2.0:1788359200.957735:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce974d85 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445276928:12345-0@lo:400: Request processed in 61us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359200.957742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788359200.957789:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000013385fc4 x1875230445276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359200.957805:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000013385fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445276928:0@lo:400: 00000100:00100000:1.0:1788359200.957882:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445276800 00000100:00100000:1.0:1788359200.957887:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445276800 00000100:00100000:1.0:1788359200.957939:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788359200.957946:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024cf5007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3644:x1875230445276800:12345-0@lo:400: 00000100:00100000:1.0:1788359200.957981:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024cf5007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3644:x1875230445276800:12345-0@lo:400: Request processed in 37us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359200.957987:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359200.958354:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000016160bbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445276800:0@lo:400: 00010000:00010000:1.0:1788359201.149751:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359202.172698:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359203.196775:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359204.235407:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359205.244659:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359206.077699:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445277184:0@lo:400: 00000100:00100000:1.0:1788359206.077769:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359206.078061:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000080cff3ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445277056:0@lo:400: 00000100:00100000:2.0:1788359206.078095:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359206.078131:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277056 00000100:00100000:2.0:1788359206.078138:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277056 00000100:00100000:2.0:1788359206.078179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359206.078193:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031329b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3643:x1875230445277056:12345-0@lo:400: 00000100:00100000:2.0:1788359206.078239:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031329b58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3643:x1875230445277056:12345-0@lo:400: Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359206.078246:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359206.078289:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000080cff3ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445277056:0@lo:400: 00000100:00100000:0.0:1788359206.079569:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277184 00000100:00100000:0.0:1788359206.079581:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277184 00000100:00100000:0.0:1788359206.079627:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359206.079634:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001387f95d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445277184:12345-0@lo:400: 00000100:00100000:0.0:1788359206.079696:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001387f95d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445277184:12345-0@lo:400: Request processed in 63us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359206.079702:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788359206.082737:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009e92c079 x1875230445277184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359206.082754:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445277184:0@lo:400: 00010000:00010000:1.0:1788359206.272684:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359207.296096:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788359208.147993:0:7444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788359208.148000:0:7444:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788359208.148002:0:7444:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788359208.148157:0:7444:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000dacf394b 00000020:01000004:3.0:1788359208.148179:0:7444:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788359208.148193:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359208.148223:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000bcb2a4a5) 00000020:00000080:3.0:1788359208.148243:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788359208.210053:0:7444:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1788359208.210212:0:7444:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788359208.239102:0:7444:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788359208.239339:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788359208.239350:0:7444:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788359208.239362:0:7444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae07f 00000020:01000004:2.0:1788359208.239369:0:7444:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788359208.239391:0:7444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788359208.239394:0:7444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788359208.239400:0:7444:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788359208.239427:0:7444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788359208.239431:0:7444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788359208.283721:0:7444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788359208.283764:0:7444:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.152@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788359208.283769:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788359208.283772:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788359208.283774:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359208.283776:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359208.283777:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359208.283779:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359208.283780:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359208.283781:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359208.283783:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359208.283785:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359208.283787:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359208.283791:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788359208.283793:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359208.283796:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788359208.283797:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359208.283805:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359208.283806:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359208.283808:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359208.283809:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359208.283811:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359208.283812:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359208.283813:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359208.283815:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359208.283841:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788359208.283873:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000845a2903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445277312:0@lo:253: 00000100:00100000:2.0:1788359208.283949:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359208.284021:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b36964a8 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.284182:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277312 00000100:00100000:0.0:1788359208.284198:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277312 00000100:00100000:0.0:1788359208.284284:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788359208.284294:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bc0e0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445277312:12345-0@lo:253: 20000000:01000000:0.0:1788359208.284345:0:6508:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788359208.284352:0:6508:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788359208.284357:0:6508:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788359208.284362:0:6508:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788359208.284416:0:6508:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788359208.285349:0:6508:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359208.286928:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788359208.286962:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788359208.286992:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788359208.287010:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788359208.287027:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788359208.287131:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788359208.287139:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788359208.287153:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788359208.287159:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788359208.287173:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788359208.287179:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788359208.287191:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788359208.287204:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788359208.287317:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788359208.287326:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788359208.287346:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788359208.287353:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788359208.287365:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788359208.287371:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:0.0:1788359208.287383:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788359208.287389:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788359208.287416:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788359208.287433:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788359208.287445:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788359208.291217:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788359208.291261:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788359208.291280:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788359208.291298:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788359208.291318:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788359208.291326:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788359208.291339:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788359208.291358:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788359208.291363:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788359208.291407:0:6508:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788359208.291417:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788359208.297229:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788359208.297600:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788359208.297640:0:6508:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.152@tcp for mdt 20000000:01000000:2.0:1788359208.297643:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788359208.297662:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788359208.297674:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788359208.297691:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788359208.297697:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:2.0:1788359208.297713:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788359208.297721:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788359208.297733:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788359208.297747:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788359208.297805:0:6508:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788359208.298576:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788359208.307680:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788359208.313178:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788359208.313216:0:6508:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.202.152@tcp for mdt 20000000:01000000:2.0:1788359208.313218:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788359208.313234:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788359208.313241:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788359208.313255:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788359208.313260:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:2.0:1788359208.313292:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788359208.313302:0:6508:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788359208.313315:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788359208.313331:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788359208.313367:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788359208.313371:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788359208.313374:0:6508:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788359208.313445:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788359208.313448:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788359208.315225:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788359208.315265:0:7452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788359208.315283:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788359208.315521:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788359208.315547:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788359208.315566:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788359208.315580:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788359208.315583:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788359208.316114:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788359208.316133:0:7453:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788359208.316146:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788359208.316290:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788359208.316309:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788359208.316325:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788359208.316333:0:6508:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788359208.316335:0:6508:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00010000:00010000:1.0:1788359208.317293:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788359208.321159:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788359208.321318:0:7454:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788359208.321333:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788359208.321876:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788359208.321922:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788359208.321953:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788359208.321972:0:6508:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788359208.321976:0:6508:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788359208.321985:0:6508:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788359208.321995:0:6508:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788359208.324325:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788359208.324461:0:6508:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788359208.341788:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788359208.341917:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342005:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342013:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342037:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342044:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342087:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.342102:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.342118:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000034a57b1d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277440:0@lo:104: 00000100:00100000:2.0:1788359208.345142:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359208.345246:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.345263:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 12 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.345277:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277568:0@lo:104: 00000100:00100000:2.0:1788359208.345323:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.345873:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277440 00000100:00100000:3.0:1788359208.345892:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277440 00000100:00100000:0.0:1788359208.345937:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277568 00000100:00100000:0.0:1788359208.345948:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277568 00000100:00100000:3.0:1788359208.345959:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359208.345973:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab9e206e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6508:x1875230445277440:12345-0@lo:104: 00010000:00010000:3.0:1788359208.345996:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.346108:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359208.346114:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab9e206e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6508:x1875230445277440:12345-0@lo:104: Request processed in 145us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359208.346133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788359208.346138:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359208.346146:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346163:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c726b690 already unused, calling callback (00000000e798e4a8) 10000000:00010000:0.0:1788359208.346178:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359208.346184:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359208.346199:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2791651 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6508:x1875230445277568:12345-0@lo:104: 00010000:00010000:3.0:1788359208.346217:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346220:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359208.346249:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359208.346256:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359208.346286:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359208.346292:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2791651 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6508:x1875230445277568:12345-0@lo:104: Request processed in 101us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359208.346301:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788359208.346303:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346313:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359208.346338:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346914:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000c726b690/0x49dd053b5feae040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae047 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346946:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359208.346949:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346955:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000268d95f2 already unused, calling callback (00000000e798e4a8) 10000000:00010000:0.0:1788359208.346957:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.346964:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359208.346970:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359208.346984:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359208.347002:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347008:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359208.347025:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347032:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feadfd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfd7 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347042:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359208.347044:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359208.347045:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359208.347073:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000014df000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445277696:0@lo:103: 00000100:00100000:0.0:1788359208.347127:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.347281:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445277824:0@lo:103: 00000100:00100000:0.0:1788359208.347307:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.347421:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277696 00000100:00100000:0.0:1788359208.347427:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277696 00010000:00010000:0.0:1788359208.347449:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 13 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.347475:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277824 00000100:00100000:0.0:1788359208.347479:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277824 00010000:00010000:0.0:1788359208.347489:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 14 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.347522:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359208.347537:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000683788d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3645:x1875230445277696:12345-0@lo:103: 00010000:00010000:0.0:1788359208.347548:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359208.347553:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 14 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347563:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 14 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347581:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359208.347617:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000683788d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3645:x1875230445277696:12345-0@lo:103: Request processed in 82us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.347627:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359208.347645:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359208.347650:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d41db35a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3642:x1875230445277824:12345-0@lo:103: 00010000:00010000:0.0:1788359208.347659:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359208.347663:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 13 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347672:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 13 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.347681:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359208.347705:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d41db35a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3642:x1875230445277824:12345-0@lo:103: Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.347712:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359208.347753:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445277824:0@lo:103: 00000100:00100000:0.0:1788359208.347780:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000014df000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445277696:0@lo:103: 00010000:00010000:2.0:1788359208.347952:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.347963:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 12 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.347973:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a5d9cedc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277952:0@lo:104: 00000100:00100000:2.0:1788359208.348008:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359208.348024:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037206b16 going to sleep for 11 seconds 00010000:00010000:2.0:1788359208.348040:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013743d4b/0x49dd053b5feae047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae040 expref: 12 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.348053:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000034a57b1d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277440:0@lo:104: 00010000:00010000:2.0:1788359208.348064:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e4e5f40/0x49dd053b5feadfd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feadfd0 expref: 11 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.348071:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277568:0@lo:104: 00000100:00100000:0.0:1788359208.348431:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445277952 00000100:00100000:0.0:1788359208.348442:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445277952 00000100:00100000:0.0:1788359208.348478:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359208.348484:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000957559c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6508:x1875230445277952:12345-0@lo:104: 00010000:00010000:0.0:1788359208.348529:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.348584:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359208.348589:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000957559c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6508:x1875230445277952:12345-0@lo:104: Request processed in 105us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.348595:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788359208.348657:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359208.348884:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.348897:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1d00622 already unused, calling callback (00000000e798e4a8) 10000000:00010000:3.0:1788359208.348901:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.348911:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359208.348919:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359208.348925:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359208.348984:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.348991:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359208.349012:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.349035:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feadfb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feadfbb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.349057:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359208.349059:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359208.349060:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359208.349255:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cde95805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445278080:0@lo:103: 00000100:00100000:0.0:1788359208.349290:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.349353:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278080 00000100:00100000:3.0:1788359208.349362:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278080 00010000:00010000:3.0:1788359208.349395:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 11 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359208.349441:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359208.349450:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000014df000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:3643:x1875230445278080:12345-0@lo:103: 00010000:00010000:3.0:1788359208.349464:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359208.349471:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 11 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.349486:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 11 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.349551:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a5d9cedc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6508:1875230445277952:0@lo:104: 00010000:00010000:1.0:1788359208.350585:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359208.350725:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359343:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a7c1978d/0x49dd053b5feadfbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feadfb4 expref: 11 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359382:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359393:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359450:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359457:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359464:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359471:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359477:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000084fa0f64 already unused, calling callback (00000000117919a9) 00010000:00010000:3.0:1788359208.359481:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.359488:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.363752:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.363775:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788359208.363789:0:6508:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:3.0:1788359208.367889:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.367923:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084fa0f64/0x49dd053b5feae086 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.367966:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359208.368180:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000014df000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:3643:x1875230445278080:12345-0@lo:103: Request processed in 18713us (18871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.368202:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359208.368637:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cde95805 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445278080:0@lo:103: 00000100:00100000:2.0:1788359208.369726:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bc0e0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:7444:x1875230445277312:12345-0@lo:253: Request processed in 85430us (85774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.369739:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788359208.370000:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000845a2903 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445277312:0@lo:253: 10000000:01000000:0.0:1788359208.370018:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788359208.370022:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359208.370023:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788359208.370025:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359208.370026:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788359208.370027:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359208.370028:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359208.370030:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359208.370031:0:7444:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788359208.370033:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359208.370035:0:7444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788359208.370150:0:7444:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dacf394b from lustre-MDT0001 10000000:01000000:0.0:1788359208.370252:0:7444:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788359208.370256:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788359208.370262:0:7444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0eaf5930000 local copy 10000000:01000000:0.0:1788359208.370267:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788359208.370308:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.370332:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.370342:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.370432:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278208:0@lo:101: 00000100:00100000:0.0:1788359208.370481:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.370569:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7d64d21 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.370677:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278208 00000100:00100000:1.0:1788359208.370685:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278208 00000100:00100000:1.0:1788359208.370735:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359208.370743:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c71b24a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:7444:x1875230445278208:12345-0@lo:101: 00010000:00010000:1.0:1788359208.370766:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359208.370780:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000603abbfa/0x49dd053b5feae094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae08d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.370913:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000603abbfa/0x49dd053b5feae094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae08d expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.370924:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000603abbfa/0x49dd053b5feae094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae08d expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.371002:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000603abbfa, rc 0) 00000100:00100000:1.0:1788359208.371046:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c71b24a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:7444:x1875230445278208:12345-0@lo:101: Request processed in 304us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.371053:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788359208.371284:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278208:0@lo:101: 00010000:00010000:0.0:1788359208.371297:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.371306:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.371487:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278336:0@lo:501: 00000100:00100000:1.0:1788359208.384067:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.384146:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c7d64d21 going to sleep for 11 seconds 00000100:00100000:3.0:1788359208.384161:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278336 00000100:00100000:3.0:1788359208.384180:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278336 00000100:00100000:3.0:1788359208.384269:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788359208.384279:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d13c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:7444:x1875230445278336:12345-0@lo:501: 00000100:00100000:3.0:1788359208.384483:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d13c46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:7444:x1875230445278336:12345-0@lo:501: Request processed in 205us (424us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788359208.384529:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359208.385540:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000059796bb6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278336:0@lo:501: 10000000:01000000:1.0:1788359208.385571:0:7444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788359208.385617:0:7444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788359208.385624:0:7444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.385634:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.385641:0:7444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.385662:0:7444:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788359208.385706:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eaf6cef800 10000000:01000000:1.0:1788359208.385711:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788359208.385716:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0eaf5930000 10000000:01000000:1.0:1788359208.385718:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788359208.385721:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa0eaf5930000 from 1 10000000:01000000:1.0:1788359208.385723:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788359208.385755:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.385762:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.385771:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.385787:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278464:0@lo:101: 00000100:00100000:1.0:1788359208.385855:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.385886:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab43d721 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.385970:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278464 00000100:00100000:0.0:1788359208.385978:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278464 00000100:00100000:0.0:1788359208.386032:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788359208.386039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c87f47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:7444:x1875230445278464:12345-0@lo:101: 00010000:00010000:0.0:1788359208.386053:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359208.386066:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c726b690/0x49dd053b5feae0a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae09b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.386086:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c726b690/0x49dd053b5feae0a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae09b expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.386110:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c726b690/0x49dd053b5feae0a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae09b expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.386120:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c726b690, rc 0) 00000100:00100000:0.0:1788359208.386157:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c87f47f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:7444:x1875230445278464:12345-0@lo:101: Request processed in 118us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.386163:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788359208.386921:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278464:0@lo:101: 00010000:00010000:3.0:1788359208.386982:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359208.387000:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.387013:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387016:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008d682b7 already unused, calling callback (00000000e798e4a8) 10000000:00010000:3.0:1788359208.387026:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.387037:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387043:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359208.387064:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359208.387072:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788359208.387075:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788359208.387088:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.387096:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 000000009b49c27d/0x49dd053b5feae09b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359208.387116:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0eaf6cef800 10000000:01000000:1.0:1788359208.387121:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788359208.387126:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0eaf6cef800 from 1 10000000:01000000:1.0:1788359208.387128:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788359208.387150:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.387156:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387256:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387266:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359208.387281:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387301:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.387307:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278720:0@lo:101: 00010000:00010000:3.0:1788359208.387326:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 0000000008d682b7/0x49dd053b5feae08d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae094 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387362:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359208.387365:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359208.387380:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359208.387438:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a6768215 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445278592:0@lo:103: 00000100:00100000:1.0:1788359208.387458:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.387635:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278720 00000100:00100000:3.0:1788359208.387645:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278720 00000100:00100000:3.0:1788359208.387710:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359208.387719:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000560e4b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:7444:x1875230445278720:12345-0@lo:101: 00010000:00010000:3.0:1788359208.387738:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359208.387759:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000620b001b/0x49dd053b5feae0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae0a9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387788:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000620b001b/0x49dd053b5feae0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae0a9 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387799:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000620b001b/0x49dd053b5feae0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae0a9 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.387807:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000620b001b, rc 0) 00000100:00100000:1.0:1788359208.388044:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab43d721 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.390076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.390393:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278592 00000100:00100000:1.0:1788359208.390408:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278592 00000100:00100000:1.0:1788359208.390489:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359208.391291:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3e864e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3644:x1875230445278592:12345-0@lo:103: 00010000:00010000:1.0:1788359208.391318:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359208.391345:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000603abbfa/0x49dd053b5feae094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae08d expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.391373:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359208.391461:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3e864e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:3644:x1875230445278592:12345-0@lo:103: Request processed in 184us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.391471:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359208.391840:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a6768215 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445278592:0@lo:103: 00000100:00100000:2.0:1788359208.392101:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000560e4b42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:7444:x1875230445278720:12345-0@lo:101: Request processed in 4375us (4637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.392134:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359208.392235:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278720:0@lo:101: 00010000:00010000:1.0:1788359208.392260:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.392274:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359208.392290:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788359208.392349:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.392357:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000d1d00622/0x49dd053b5feae0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359208.392366:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788359208.392373:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359208.392381:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0eaf6cef800 10000000:01000000:1.0:1788359208.392384:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788359208.392388:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788359208.392391:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788359208.392443:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.392451:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.392459:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.392481:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278848:0@lo:101: 00000100:00100000:1.0:1788359208.392595:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.392627:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab43d721 going to sleep for 11 seconds 00000100:00100000:2.0:1788359208.392890:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278848 00000100:00100000:2.0:1788359208.392902:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278848 00000100:00100000:2.0:1788359208.392968:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359208.392976:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000986be77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:7444:x1875230445278848:12345-0@lo:101: 00010000:00010000:2.0:1788359208.392997:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359208.393017:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013743d4b/0x49dd053b5feae0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae0b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.393046:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013743d4b/0x49dd053b5feae0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.393058:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013743d4b/0x49dd053b5feae0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359208.393067:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013743d4b, rc 0) 00000100:00100000:2.0:1788359208.393126:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000986be77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445278848:12345-0@lo:101: Request processed in 151us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.393132:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359208.394077:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278848:0@lo:101: 00010000:00010000:3.0:1788359208.394113:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.394126:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.394571:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a5d9cedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278976:0@lo:501: 00000100:00100000:2.0:1788359208.394633:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359208.394682:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000075981f85 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.394777:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445278976 00000100:00100000:0.0:1788359208.394784:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445278976 00000100:00100000:0.0:1788359208.394839:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788359208.394857:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad69be99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445278976:12345-0@lo:501: 00000100:00100000:0.0:1788359208.395050:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad69be99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445278976:12345-0@lo:501: Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.395059:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788359208.395996:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a5d9cedc pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445278976:0@lo:501: 00000100:00100000:1.0:1788359208.396268:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279104:0@lo:503: 00000100:00100000:1.0:1788359208.396344:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.396374:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee3a4899 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.396675:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279104 00000100:00100000:0.0:1788359208.396682:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279104 00000100:00100000:0.0:1788359208.396726:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788359208.396734:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000476444d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279104:12345-0@lo:503: 00000100:00100000:0.0:1788359208.396866:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000476444d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279104:12345-0@lo:503: Request processed in 132us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.396873:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788359208.397066:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279104:0@lo:503: 00000040:00080000:1.0:1788359208.397489:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359208.397601:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279232:0@lo:502: 00000100:00100000:1.0:1788359208.397742:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.397822:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee3a4899 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.399799:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279232 00000100:00100000:0.0:1788359208.399839:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279232 00000100:00100000:0.0:1788359208.399951:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788359208.399963:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001eaa3dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279232:12345-0@lo:502: 00000100:00100000:0.0:1788359208.400394:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001eaa3dff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279232:12345-0@lo:502: Request processed in 431us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.400405:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359208.400620:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279232:0@lo:502: 00000040:00080000:2.0:1788359208.401287:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788359208.401339:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788359208.401357:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788359208.401371:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788359208.401386:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788359208.401411:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788359208.401427:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788359208.401440:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788359208.401452:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788359208.401467:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788359208.401485:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788359208.401599:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788359208.401615:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788359208.401629:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788359208.401644:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788359208.401782:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788359208.401804:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788359208.401818:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788359208.401831:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788359208.401886:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788359208.401904:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788359208.401922:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788359208.401935:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788359208.401992:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279360:0@lo:502: 00000100:00100000:2.0:1788359208.402098:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359208.402231:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 000000003fdc9e59 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.402298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279360 00000100:00100000:1.0:1788359208.402309:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279360 00000100:00100000:1.0:1788359208.402419:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788359208.402430:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89f7bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279360:12345-0@lo:502: 00000100:00100000:1.0:1788359208.402617:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89f7bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279360:12345-0@lo:502: Request processed in 188us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.402626:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788359208.402774:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279360:0@lo:502: 00000040:00080000:2.0:1788359208.402837:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788359208.402861:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788359208.403467:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359208.403484:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359208.403487:0:7456:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788359208.403517:0:7456:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788359208.403520:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359208.403541:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004fafe603) 00000020:00000080:2.0:1788359208.403567:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788359208.403586:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788359208.403707:0:7456:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788359208.403716:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae0cc 00000020:00000080:2.0:1788359208.403998:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788359208.404003:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359208.404007:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359208.404009:0:7456:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788359208.404012:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359208.404016:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359208.404017:0:7456:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788359208.404021:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359208.404029:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000001fc06b51) 00000020:00000080:2.0:1788359208.404041:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788359208.404046:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788359208.404048:0:7456:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788359208.404050:0:7456:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788359208.404058:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788359208.404108:0:7456:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dacf394b from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788359208.404125:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d4ab7445) 00000020:00000080:2.0:1788359208.404134:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788359208.404226:0:7456:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788359208.404243:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae0e1 00000020:00000080:2.0:1788359208.404350:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788359208.404357:0:7456:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788359208.404363:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x49dd053b5feae0e8 00080000:01000000:2.0:1788359208.404369:0:7456:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788359208.404374:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae0ef 00080000:10000000:2.0:1788359208.404958:0:7456:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788359208.405103:0:7456:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788359208.488273:0:7456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788359208.488818:0:7456:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788359208.491588:0:7456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788359208.492059:0:7456:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788359208.502408:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788359208.502430:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359208.502438:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.502442:0:7456:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788359208.502446:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359208.502454:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.502456:0:7456:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788359208.502466:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788359208.502473:0:7456:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:00000080:3.0:1788359208.502553:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359208.502576:0:7456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000007d7c12de) 00000020:00000080:3.0:1788359208.502610:0:7456:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788359208.502619:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788359208.502748:0:7456:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788359208.502757:0:7456:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788359208.502768:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae0fd 00010000:00080000:3.0:1788359208.502855:0:7456:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009a61615d@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359208.505031:0:7456:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788359208.506436:0:7456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788359208.506456:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788359208.506684:0:7456:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788359208.506715:0:7456:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae104 00000100:00080000:3.0:1788359208.506731:0:7456:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359208.506737:0:7456:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009a61615d using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359208.506785:0:7456:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d266221b x1875230445279488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359208.506863:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d266221b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445279488:0@lo:38: 00000100:00100000:1.0:1788359208.506959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788359208.507023:0:7456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788359208.507157:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000690b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445279616:0@lo:400: 00000020:01000000:3.0:1788359208.507179:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359208.507185:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.507188:0:7456:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788359208.507191:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788359208.507193:0:7456:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788359208.507195:0:7456:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359208.507196:0:7456:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359208.507198:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788359208.507200:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.507201:0:7456:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788359208.507204:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359208.507219:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.507220:0:7456:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788359208.507226:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788359208.507282:0:7456:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788359208.507301:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359208.507305:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.507307:0:7456:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788359208.507310:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359208.507320:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788359208.507320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788359208.507325:0:7456:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788359208.507331:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788359208.507333:0:7456:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788359208.507371:0:7456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359208.507373:0:7456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359208.507375:0:7456:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788359208.507378:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1788359208.507453:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788359208.507528:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:0.0:1788359208.507530:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279616 00000100:00100000:0.0:1788359208.507541:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279616 00010000:00010000:3.0:1788359208.507553:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.507567:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 000000000e4e5f40/0x49dd053b5feae0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359208.507576:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaf6cef800 from 1 10000000:01000000:3.0:1788359208.507579:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:0.0:1788359208.507600:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359208.507611:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd78a083 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445279616:12345-0@lo:400: 00010000:00010000:3.0:1788359208.507613:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.507628:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.507652:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359208.507672:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279744:0@lo:101: 00000100:00100000:0.0:1788359208.507679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd78a083 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445279616:12345-0@lo:400: Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.507688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359208.507731:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788359208.507756:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000690b8f20 x1875230445279616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359208.507772:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000690b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445279616:0@lo:400: 00000100:00100000:3.0:1788359208.507773:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef909af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.507893:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279744 00000100:00100000:0.0:1788359208.507900:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279744 00000100:00100000:0.0:1788359208.507931:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788359208.507937:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b96f38b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:7444:x1875230445279744:12345-0@lo:101: 00010000:00010000:0.0:1788359208.507948:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359208.507966:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae10b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.507993:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae10b expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.508017:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae10b expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.508029:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de003629, rc 0) 00000100:00100000:0.0:1788359208.508086:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b96f38b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7444:x1875230445279744:12345-0@lo:101: Request processed in 150us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.508093:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788359208.508171:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279744:0@lo:101: 00010000:00010000:3.0:1788359208.508190:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.508200:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.508625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279488 00000100:00100000:2.0:1788359208.508633:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279488 00000100:00100000:2.0:1788359208.508717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359208.508726:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077b1b14a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445279488:12345-0@lo:38: 00010000:00080000:2.0:1788359208.508754:0:6520:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1788359208.508804:0:6520:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae119 00000004:00100000:2.0:1788359208.508825:0:6520:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788359208.508832:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788359208.509275:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279872:0@lo:256: 00000100:00100000:3.0:1788359208.509344:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.509387:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef909af1 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.509445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445279872 00000100:00100000:0.0:1788359208.509456:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445279872 00000100:00100000:0.0:1788359208.509528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359208.509540:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cb4c201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7444:x1875230445279872:12345-0@lo:256: 20000000:01000000:0.0:1788359208.509563:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788359208.509581:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788359208.509585:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788359208.509727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cb4c201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7444:x1875230445279872:12345-0@lo:256: Request processed in 190us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.509736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788359208.509764:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445279872:0@lo:256: 10000000:01000000:3.0:1788359208.510479:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359208.510529:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.511012:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359208.511026:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6cef800 from 1 10000000:01000000:3.0:1788359208.511029:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359208.511866:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.511877:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.511890:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359208.511921:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280000:0@lo:101: 00000100:00100000:3.0:1788359208.512007:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.512167:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef909af1 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.512241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280000 00000100:00100000:1.0:1788359208.512250:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280000 00000100:00100000:1.0:1788359208.512373:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788359208.512388:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053325a57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7444:x1875230445280000:12345-0@lo:101: 00010000:00010000:1.0:1788359208.512410:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359208.512429:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae120 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.512474:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae120 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.512485:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae120 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.512529:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000603abbfa, rc 0) 00000100:00100000:1.0:1788359208.512584:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053325a57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280000:12345-0@lo:101: Request processed in 202us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.512594:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788359208.512644:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b46aa9ea pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280000:0@lo:101: 00010000:00010000:0.0:1788359208.512678:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.512691:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.512824:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005dce8b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280128:0@lo:501: 00000100:00100000:0.0:1788359208.519304:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.519382:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007c21bc5 going to sleep for 11 seconds 00000100:00100000:2.0:1788359208.519394:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280128 00000100:00100000:2.0:1788359208.519412:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280128 00000100:00100000:2.0:1788359208.519523:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788359208.519534:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8266db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280128:12345-0@lo:501: 00000100:00100000:2.0:1788359208.519808:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8266db3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280128:12345-0@lo:501: Request processed in 275us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.519819:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788359208.520251:0:6520:0:(import.c:65:import_set_state_nolock()) 0000000003c7cc62 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359208.520306:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077b1b14a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445279488:12345-0@lo:38: Request processed in 11582us (13348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.520315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359208.520529:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359208.520546:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788359208.520556:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788359208.520564:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788359208.520568:0:3641:0:(import.c:65:import_set_state_nolock()) 000000009a61615d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359208.520597:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d266221b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445279488:0@lo:38: 00000100:00100000:1.0:1788359208.520755:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445280256:0@lo:41: 00000100:00100000:1.0:1788359208.520797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359208.520895:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280256 00000100:00100000:2.0:1788359208.520901:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280256 00000100:00100000:2.0:1788359208.520935:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788359208.520941:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000024dca1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875230445280256:12345-0@lo:41: 00000004:00000024:2.0:1788359208.520968:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788359208.521004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000024dca1e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875230445280256:12345-0@lo:41: Request processed in 63us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359208.521021:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359208.521243:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000012796a5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445280256:0@lo:41: 00000100:00100000:0.0:1788359208.521422:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005dce8b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280128:0@lo:501: 00000100:00100000:0.0:1788359208.521469:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005dce8b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280384:0@lo:503: 00000100:00100000:0.0:1788359208.521622:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.521692:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007c21bc5 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.521734:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280384 00000100:00100000:1.0:1788359208.521739:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280384 00000100:00100000:1.0:1788359208.521808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788359208.521815:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6d72a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280384:12345-0@lo:503: 00000040:00080000:1.0:1788359208.521897:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359208.521952:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6d72a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280384:12345-0@lo:503: Request processed in 138us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.521964:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788359208.522040:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005dce8b5f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280384:0@lo:503: 00000040:00080000:3.0:1788359208.522466:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359208.522560:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788359208.522661:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359208.525820:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788359208.526043:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788359208.526088:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359208.526219:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.526235:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359208.526292:0:7444:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788359208.526295:0:7444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eaf6cef800 10000000:01000000:0.0:1788359208.526297:0:7444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eaf6cef800 10000000:01000000:0.0:1788359208.526300:0:7444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359208.526306:0:7444:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6cef800 from 1 10000000:01000000:0.0:1788359208.526308:0:7444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359208.526355:0:7444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.526360:0:7444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.526369:0:7444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.526392:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000f1e5462 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280512:0@lo:101: 00000100:00100000:0.0:1788359208.526475:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.526566:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f1cf1a03 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.526569:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280512 00000100:00100000:1.0:1788359208.526578:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280512 00000100:00100000:1.0:1788359208.526636:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788359208.526646:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092556f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7444:x1875230445280512:12345-0@lo:101: 00010000:00010000:1.0:1788359208.526663:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359208.526678:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf52e1fc/0x49dd053b5feae135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae12e expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.526705:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf52e1fc/0x49dd053b5feae135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae12e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.526716:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf52e1fc/0x49dd053b5feae135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae12e expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.526726:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf52e1fc, rc 0) 00000100:00100000:1.0:1788359208.526827:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092556f1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280512:12345-0@lo:101: Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.526835:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788359208.528000:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000f1e5462 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280512:0@lo:101: 00010000:00010000:3.0:1788359208.528040:0:7444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.528051:0:7444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359208.528321:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000efa6b33b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280640:0@lo:501: 00000100:00100000:3.0:1788359208.528379:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.528428:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 000000003fdc9e59 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.528578:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280640 00000100:00100000:1.0:1788359208.528585:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280640 00000100:00100000:1.0:1788359208.528636:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788359208.528644:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df6e813c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280640:12345-0@lo:501: 00000100:00100000:1.0:1788359208.528790:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df6e813c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280640:12345-0@lo:501: Request processed in 146us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.528797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788359208.528881:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000efa6b33b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280640:0@lo:501: 00000100:00100000:0.0:1788359208.528923:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e764da13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280768:0@lo:503: 00000100:00100000:0.0:1788359208.528974:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.529005:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062c2af67 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.529101:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280768 00000100:00100000:1.0:1788359208.529106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280768 00000100:00100000:1.0:1788359208.529236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788359208.529242:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e407f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280768:12345-0@lo:503: 00000100:00100000:1.0:1788359208.529332:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e407f68 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280768:12345-0@lo:503: Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.529338:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788359208.531463:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e764da13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280768:0@lo:503: 00000040:00080000:0.0:1788359208.531937:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359208.532060:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e764da13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280896:0@lo:502: 00000100:00100000:0.0:1788359208.532322:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.532418:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062c2af67 going to sleep for 11 seconds 00000100:00100000:3.0:1788359208.532469:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445280896 00000100:00100000:3.0:1788359208.532478:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445280896 00000100:00100000:3.0:1788359208.533360:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359208.533372:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095e08529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280896:12345-0@lo:502: 00000100:00100000:3.0:1788359208.533586:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095e08529 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445280896:12345-0@lo:502: Request processed in 216us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359208.533594:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788359208.533717:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e764da13 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445280896:0@lo:502: 00000040:00080000:1.0:1788359208.534018:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788359208.534055:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788359208.534084:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788359208.534109:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788359208.534127:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788359208.534141:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788359208.534154:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788359208.534168:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788359208.534181:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788359208.534194:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788359208.534205:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788359208.534216:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788359208.534230:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788359208.534243:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788359208.534256:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788359208.534270:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788359208.534285:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788359208.534299:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788359208.534313:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788359208.534326:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788359208.534340:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788359208.534355:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788359208.534369:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788359208.534383:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788359208.534416:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788359208.534439:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788359208.534451:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788359208.534463:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788359208.534560:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445281024:0@lo:502: 00000100:00100000:1.0:1788359208.534620:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.535009:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 0000000094c0cfc6 going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.535192:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281024 00000100:00100000:0.0:1788359208.535202:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281024 00000100:00100000:0.0:1788359208.535248:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788359208.535255:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000365703b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445281024:12345-0@lo:502: 00000100:00100000:0.0:1788359208.535401:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000365703b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445281024:12345-0@lo:502: Request processed in 146us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.535409:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788359208.535535:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445281024:0@lo:502: 00000040:00080000:1.0:1788359208.535598:0:7444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788359208.535612:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788359208.536321:0:7462:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788359208.536355:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000bf939d20) 00000020:00000080:1.0:1788359208.536382:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788359208.536644:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dacf394b from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788359208.536650:0:7462:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dacf394b from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788359208.536653:0:7462:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000dacf394b 3 00010000:00080000:1.0:1788359208.536706:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000a1ca978@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359208.541339:0:7462:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788359208.541482:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788359208.541560:0:7462:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788359208.541578:0:7462:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x49dd053b5feae143 00000100:00080000:1.0:1788359208.541593:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359208.541600:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000000a1ca978 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359208.541671:0:7462:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003c71d53f x1875230445281152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359208.541700:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788359208.542431:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445281152:0@lo:38: 00000100:00100000:2.0:1788359208.542588:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788359208.542912:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788359208.543189:0:7464:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788359208.543325:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281152 00000100:00100000:0.0:1788359208.543337:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281152 00000100:00100000:0.0:1788359208.543388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359208.543396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034a57b1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445281152:12345-0@lo:38: 00010000:00080000:0.0:1788359208.543431:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1788359208.543479:0:6516:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x49dd053b5feae14a 00000004:00100000:0.0:1788359208.543524:0:6516:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788359208.543561:0:6516:0:(import.c:65:import_set_state_nolock()) 000000007315debc : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359208.543636:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034a57b1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875230445281152:12345-0@lo:38: Request processed in 239us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.543655:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788359208.543684:0:7444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788359208.543719:0:7444:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359208.543737:0:7444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.543749:0:7444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 00000000e5614a9b/0x49dd053b5feae12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788359208.543819:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788359208.543822:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788359208.543823:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359208.543824:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359208.543826:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359208.543827:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359208.543828:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359208.543830:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359208.543831:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359208.543833:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359208.543835:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359208.543840:0:7444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788359208.543854:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788359208.543856:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788359208.543857:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359208.543858:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359208.543859:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359208.543860:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359208.543861:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359208.543862:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359208.543862:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359208.543863:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359208.543864:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359208.543889:0:7444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788359208.543906:0:7444:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445281280:0@lo:253: 00000100:00100000:0.0:1788359208.543953:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.543987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281280 00000100:00100000:0.0:1788359208.543991:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281280 00000100:00100000:0.0:1788359208.544027:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788359208.544032:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039afd943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445281280:12345-0@lo:253: 20000000:01000000:0.0:1788359208.544058:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00080000:1.0:1788359208.544287:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003c71d53f x1875230445281152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359208.544313:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359208.544323:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788359208.544333:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788359208.544337:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788359208.544340:0:3641:0:(import.c:65:import_set_state_nolock()) 000000000a1ca978 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359208.544346:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445281152:0@lo:38: 20000000:01000000:0.0:1788359208.544447:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788359208.544726:0:7444:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2a26e27 going to sleep for 11 seconds 00000001:00100000:1.0:1788359208.548466:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788359208.548566:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788359208.548585:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788359208.548618:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788359208.548629:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788359208.548653:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.548676:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae06a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.548686:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae10b expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.548694:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.548760:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 15 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.548778:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 15 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.548795:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445281408:0@lo:104: 00000100:00100000:1.0:1788359208.548896:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.548973:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281408 00010000:00010000:1.0:1788359208.548985:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.548988:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281408 00010000:00010000:1.0:1788359208.549000:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 15 pid: 6510 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.549011:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f04826ca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445281536:0@lo:104: 00000100:00100000:1.0:1788359208.549039:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.549051:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281536 00000100:00100000:0.0:1788359208.549056:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281536 00000100:00100000:0.0:1788359208.549213:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359208.549223:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c41d43dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445281408:12345-0@lo:104: 00010000:00010000:0.0:1788359208.549243:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549343:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359208.549349:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c41d43dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445281408:12345-0@lo:104: Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.549357:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359208.549376:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359208.549381:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ab51cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445281536:12345-0@lo:104: 00010000:00010000:0.0:1788359208.549387:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.549406:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set 000000000eb22f52 going to sleep for 11 seconds 00010000:00010000:0.0:1788359208.549420:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788359208.549427:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ab51cf7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445281536:12345-0@lo:104: Request processed in 45us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.549440:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359208.549444:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003c71d53f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445281408:0@lo:104: 00000100:00100000:1.0:1788359208.549464:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f04826ca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445281536:0@lo:104: 00010000:00010000:0.0:1788359208.549472:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359208.549478:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549487:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2ec2299 already unused, calling callback (00000000e798e4a8) 00010000:00010000:1.0:1788359208.549490:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359208.549528:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549539:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359208.549547:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359208.549553:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359208.549595:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549603:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359208.549630:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549636:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000b2ec2299/0x49dd053b5feae10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae112 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549650:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359208.549652:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549666:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d065b8a already unused, calling callback (00000000e798e4a8) 10000000:00010000:0.0:1788359208.549668:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549673:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359208.549678:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359208.549682:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359208.549732:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549739:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788359208.549747:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab33e06c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445281664:0@lo:103: 00010000:00010000:0.0:1788359208.549753:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549761:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 000000007d065b8a/0x49dd053b5feae06a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.549778:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359208.549779:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359208.549782:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359208.549806:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c3c70f17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445281792:0@lo:103: 00000100:00100000:1.0:1788359208.549902:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.549926:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039afd943 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7444:x1875230445281280:12345-0@lo:253: Request processed in 5891us (5970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.549936:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788359208.549999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359208.551238:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359208.552855:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281664 00000100:00100000:1.0:1788359208.552874:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281664 00000100:00100000:0.0:1788359208.552919:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281792 00000100:00100000:0.0:1788359208.552930:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281792 00010000:00010000:1.0:1788359208.552940:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 16 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359208.552963:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 16 pid: 6510 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359208.552996:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359208.553008:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f04826ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3643:x1875230445281664:12345-0@lo:103: 00010000:00010000:1.0:1788359208.553026:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359208.553032:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 16 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359208.553088:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788359208.553099:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788359208.553184:0:7444:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7444:1875230445281280:0@lo:253: 10000000:01000000:0.0:1788359208.553200:0:7444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788359208.553203:0:7444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359208.553205:0:7444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788359208.553207:0:7444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359208.553208:0:7444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359208.553210:0:7444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359208.553211:0:7444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359208.553212:0:7444:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359208.553214:0:7444:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359208.553216:0:7444:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359208.553218:0:7444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359208.553220:0:7444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788359208.553237:0:7444:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788359208.553712:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 16 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.553752:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de003629/0x49dd053b5feae112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae10b expref: 16 pid: 6508 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.553800:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359208.553951:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f04826ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3643:x1875230445281664:12345-0@lo:103: Request processed in 944us (4157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.553970:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359208.554007:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359208.554015:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019d7e78b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3644:x1875230445281792:12345-0@lo:103: 00010000:00010000:1.0:1788359208.554039:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359208.554044:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 14 pid: 6510 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554318:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 14 pid: 6510 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554332:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ce68b17/0x49dd053b5feae071 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae06a expref: 14 pid: 6510 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554358:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554366:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788359208.554383:0:6501:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005756717s 00010000:00010000:1.0:1788359208.554402:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554409:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554415:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554422:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554428:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db1f80b0 already unused, calling callback (00000000117919a9) 00010000:00010000:1.0:1788359208.554433:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554441:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554463:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359208.554475:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359208.554543:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019d7e78b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3644:x1875230445281792:12345-0@lo:103: Request processed in 529us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.554550:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788359208.554683:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.554698:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359208.554704:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db1f80b0/0x49dd053b5feae151 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359208.556681:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c3c70f17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445281792:0@lo:103: 00000100:00100000:1.0:1788359208.557299:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab33e06c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445281664:0@lo:103: 00080000:10000000:0.0:1788359208.558538:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.558700:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788359208.558885:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.559032:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788359208.559232:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.559383:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788359208.563339:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.564217:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788359208.564454:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.564878:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788359208.565151:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788359208.565365:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788359208.579348:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788359208.579422:0:7468:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788359208.579433:0:7468:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788359208.579941:0:7469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788359208.580036:0:7469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875230445281920:0@lo:700: 00000100:00100000:0.0:1788359208.580291:0:7469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.580368:0:7469:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027d3ada going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.580461:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445281920 00000100:00100000:1.0:1788359208.580474:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445281920 00000100:00100000:1.0:1788359208.580562:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359208.580571:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003973e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875230445281920:12345-0@lo:700: 00000040:01000000:2.0:1788359208.580655:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788359208.581405:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282048:0@lo:1000: 00000100:00100000:1.0:1788359208.581476:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.581574:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282048 00000100:00100000:1.0:1788359208.581576:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 0000000017b77649 going to sleep for 11 seconds 00000100:00100000:3.0:1788359208.581586:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282048 00000100:00100000:3.0:1788359208.581650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359208.581658:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f04826ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282048:12345-0@lo:1000: 00000100:00100000:3.0:1788359208.581801:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f04826ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282048:12345-0@lo:1000: Request processed in 143us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359208.581809:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359208.581937:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282048:0@lo:1000: 00000040:01000000:1.0:1788359208.581974:0:7470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788359208.582004:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282176:0@lo:700: 00000100:00100000:1.0:1788359208.582036:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.582071:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f10087d going to sleep for 11 seconds 00000100:00100000:0.0:1788359208.582198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282176 00000100:00100000:0.0:1788359208.582205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282176 00000100:00100000:0.0:1788359208.582245:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359208.582252:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c71d53f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282176:12345-0@lo:700: 00000100:00100000:0.0:1788359208.582320:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c71d53f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282176:12345-0@lo:700: Request processed in 68us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359208.582327:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359208.582381:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282176:0@lo:700: 00000100:00100000:3.0:1788359208.582450:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058459489 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875230445282304:0@lo:900: 00000100:00100000:3.0:1788359208.582713:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.582762:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 000000007f6f4ba2 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.582918:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282304 00000100:00100000:1.0:1788359208.582938:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282304 00000100:00100000:1.0:1788359208.582988:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359208.582998:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e17b226a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875230445282304:12345-0@lo:900: 00000100:00100000:1.0:1788359208.583089:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e17b226a pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7470:x1875230445282304:12345-0@lo:900: Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.583097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788359208.583288:0:7470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000058459489 x1875230445282304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788359224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359208.583302:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058459489 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7470:1875230445282304:0@lo:900: 00000100:00100000:3.0:1788359208.583429:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000058459489 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282432:0@lo:1000: 00000100:00100000:3.0:1788359208.583467:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359208.583522:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a86ffd7 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.583785:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282432 00000100:00100000:1.0:1788359208.583791:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282432 00000100:00100000:1.0:1788359208.583918:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359208.583926:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000926f59b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282432:12345-0@lo:1000: 00000100:00100000:1.0:1788359208.584010:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000926f59b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282432:12345-0@lo:1000: Request processed in 85us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.584018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:2.0:1788359208.584607:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788359208.584785:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359208.584824:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000058459489 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282432:0@lo:1000: 00000004:00080000:0.0:1788359208.584928:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007f6f4ba2 with version 0 00000020:00100000:0.0:1788359208.584958:0:7470:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788359208.584965:0:7470:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000066699239 x1875230445282688/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359208.584988:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282688:0@lo:1000: 00000100:00100000:0.0:1788359208.585074:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.586632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282688 00000004:00000080:2.0:1788359208.586634:0:7444:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:1.0:1788359208.586655:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282688 00000040:01000000:2.0:1788359208.586658:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1788359208.586741:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359208.586754:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae040ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282688:12345-0@lo:1000: 00000040:00080000:2.0:1788359208.587001:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359208.587287:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac69166a going to sleep for 11 seconds 00000040:00080000:2.0:1788359208.589133:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788359208.591467:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788359208.591588:0:7444:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788359208.593618:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:1.0:1788359208.593969:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00080000:10000000:2.0:1788359208.595827:0:7444:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788359208.602321:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788359208.602863:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788359208.603083:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788359208.606330:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788359208.606653:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788359208.607404:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788359208.607618:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788359208.607752:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788359208.608096:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788359208.608245:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788359208.608387:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788359208.608560:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788359208.608711:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788359208.608859:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788359208.609000:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788359208.609141:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788359208.609464:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788359208.609649:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788359208.609810:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788359208.609969:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788359208.610094:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788359208.610284:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788359208.610409:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788359208.610609:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788359208.610729:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:1.0:1788359208.611373:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003973e412 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7469:x1875230445281920:12345-0@lo:700: Request processed in 30796us (31077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.611391:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788359208.611542:0:7469:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cdadb5a8 x1875230445281920/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788359224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359208.611559:0:7469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7469:1875230445281920:0@lo:700: 40000000:02000000:2.0:1788359208.611575:0:7469:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:0.0:1788359208.613270:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788359208.614804:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788359208.615616:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788359208.615769:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788359208.615919:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00000001:00080000:0.0:1788359208.617684:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788359208.617930:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae040ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282688:12345-0@lo:1000: Request processed in 31173us (32849us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788359208.617946:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788359208.617969:0:7470:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788359208.617976:0:7470:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788359208.617995:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282688:0@lo:1000: 00000100:00100000:0.0:1788359208.618126:0:7470:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282816:0@lo:1000: 00000100:00100000:0.0:1788359208.618163:0:7470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359208.618230:0:7470:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d0733d04 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.618373:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445282816 00000100:00100000:1.0:1788359208.618381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445282816 00000100:00100000:1.0:1788359208.618434:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359208.618443:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000575c54b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282816:12345-0@lo:1000: 00000100:00100000:1.0:1788359208.618561:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000575c54b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7470:x1875230445282816:12345-0@lo:1000: Request processed in 119us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359208.618568:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359208.618594:0:7470:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7470:1875230445282816:0@lo:1000: 00000040:00080000:0.0:1788359208.618616:0:7470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788359208.618653:0:7470:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ac69166a with version 1 00000004:00080000:1.0:1788359208.618702:0:7459:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a5decf48 version 1 rpc_version 1 00000020:00100000:1.0:1788359208.618726:0:7459:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788359208.618735:0:7459:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005f8d66e3 x1875230445283072/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359208.618764:0:7459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f8d66e3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1875230445283072:0@lo:1000: 00000100:00100000:1.0:1788359208.618795:0:7459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359208.618815:0:7459:0:(client.c:2702:ptlrpc_set_wait()) set 0000000017b77649 going to sleep for 11 seconds 00000100:00100000:1.0:1788359208.618832:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283072 00000100:00100000:1.0:1788359208.618836:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283072 00000100:00100000:1.0:1788359208.618871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359208.618876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000502a2847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1875230445283072:12345-0@lo:1000: 00100000:10000000:3.0:1788359208.619647:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788359208.619965:0:7444:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00080000:2.0:1788359208.622709:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788359208.622922:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000502a2847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7459:x1875230445283072:12345-0@lo:1000: Request processed in 4040us (4122us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788359208.622949:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788359208.622986:0:7459:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788359208.622993:0:7459:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788359208.623017:0:7459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f8d66e3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7459:1875230445283072:0@lo:1000: 00000001:00000004:3.0:1788359208.623370:0:7444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788359208.623925:0:7470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788359208.623998:0:7470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:3.0:1788359208.629436:0:7444:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788359208.629681:0:7444:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb78b4193b988 00100000:10000000:3.0:1788359208.629692:0:7444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788359208.630719:0:7444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788359208.630762:0:7444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788359208.630788:0:7444:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788359208.630805:0:7444:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788359208.631717:0:7444:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359208.631933:0:7444:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788359208.650437:0:7469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359208.669858:0:7469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788359208.670310:0:7469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788359208.670327:0:7469:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788359209.342467:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359210.365544:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359211.388649:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359212.412801:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788359213.095273:0:7715:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788359213.436672:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359213.756927:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445283456:0@lo:400: 00000100:00100000:1.0:1788359213.757055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359213.757149:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359213.757156:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445283328:0@lo:400: 00000100:00100000:1.0:1788359213.757187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359213.757224:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283456 00000100:00100000:1.0:1788359213.757233:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283456 00000100:00100000:1.0:1788359213.757315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788359213.757326:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080cff3ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445283456:12345-0@lo:400: 00000100:00100000:1.0:1788359213.757409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080cff3ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445283456:12345-0@lo:400: Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359213.757418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788359213.757482:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000150513c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445283456:0@lo:400: 00000100:00100000:3.0:1788359213.757610:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445283584:0@lo:400: 00000100:00100000:3.0:1788359213.757646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359213.757687:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359213.757694:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005f8d66e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445283200:0@lo:400: 00000100:00100000:3.0:1788359213.757729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359213.757765:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283200 00000100:00100000:3.0:1788359213.757769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283200 00000100:00100000:3.0:1788359213.757834:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788359213.757840:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ab768c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3644:x1875230445283200:12345-0@lo:400: 00000100:00100000:3.0:1788359213.757878:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ab768c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3644:x1875230445283200:12345-0@lo:400: Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359213.757885:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788359213.757924:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005f8d66e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445283200:0@lo:400: 00000100:00100000:3.0:1788359213.758447:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359213.758459:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000109a119a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445283712:0@lo:41: 00000100:00100000:3.0:1788359213.759455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359213.759626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283712 00000100:00100000:2.0:1788359213.759636:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283712 00000100:00100000:2.0:1788359213.759695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359213.759703:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab67db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445283712:12345-0@lo:41: 00000004:00000024:2.0:1788359213.759745:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788359213.759950:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab67db7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445283712:12345-0@lo:41: Request processed in 247us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359213.759957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359213.760103:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283328 00000100:00100000:0.0:1788359213.760110:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283328 00000100:00100000:0.0:1788359213.760149:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283584 00000100:00100000:0.0:1788359213.760153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283584 00000100:00100000:0.0:1788359213.760173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788359213.760181:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788359213.760182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016160bbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445283328:12345-0@lo:400: 00000100:00100000:2.0:1788359213.760194:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788359213.760259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016160bbf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445283328:12345-0@lo:400: Request processed in 78us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359213.760267:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359213.760280:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359213.760287:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000506c42cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445283584:12345-0@lo:400: 00000100:00100000:0.0:1788359213.760337:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000506c42cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445283584:12345-0@lo:400: Request processed in 50us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359213.760345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788359213.760418:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d101c054 x1875230445283328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359213.760437:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d101c054 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445283328:0@lo:400: 00000100:00100000:3.0:1788359213.760597:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000109a119a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445283712:0@lo:41: 00010000:00080000:3.0:1788359213.760612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009e92c079 x1875230445283584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359213.760622:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009e92c079 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445283584:0@lo:400: 00000020:00000004:1.0:1788359214.078707:0:7768:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359214.080686:0:7768:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788359214.460689:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359215.486048:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359216.527926:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788359216.817747:0:7870:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359216.817946:0:7870:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359217.533853:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788359217.892652:0:7918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3f6341f0 20000000:00000080:2.0:1788359217.892669:0:7918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0eafeee0000 uarg=0000000000000000 20000000:01000000:2.0:1788359217.892713:0:7918:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788359217.892721:0:7918:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788359217.892726:0:7918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788359217.892807:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788359217.892818:0:7918:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788359217.896102:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359217.897089:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788359217.897127:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788359217.897147:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788359217.897164:0:7918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788359217.897185:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897216:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae032 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897223:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae120 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897231:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897456:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897474:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 12 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359217.897489:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076025325 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875230445283840:0@lo:104: 00000100:00100000:2.0:1788359217.897653:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359217.897844:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.897853:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 12 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359217.897862:0:7918:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f64f3fca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875230445283968:0@lo:104: 00000100:00100000:2.0:1788359217.897884:0:7918:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ef505c93 going to sleep for 11 seconds 00000100:00100000:1.0:1788359217.898088:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788359217.898108:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359217.898131:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283840 00000100:00100000:1.0:1788359217.898137:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283840 00000100:00100000:1.0:1788359217.898170:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445283968 00000100:00100000:1.0:1788359217.898173:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445283968 00000100:00100000:1.0:1788359217.898185:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359217.898191:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c45c3973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:7918:x1875230445283840:12345-0@lo:104: 00010000:00010000:1.0:1788359217.898203:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359217.898529:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359217.898535:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c45c3973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:7918:x1875230445283840:12345-0@lo:104: Request processed in 344us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359217.898543:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359217.898592:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788359217.898599:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000150513c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:7918:x1875230445283968:12345-0@lo:104: 00010000:00010000:1.0:1788359217.898607:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359217.898643:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359217.898647:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000150513c6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:7918:x1875230445283968:12345-0@lo:104: Request processed in 50us (540us total) trans 0 rc 0/0 00010000:00010000:0.0:1788359217.898662:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788359217.898664:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788359217.898671:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898681:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000268d95f2 already unused, calling callback (00000000e798e4a8) 10000000:00010000:0.0:1788359217.898684:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898692:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359217.898699:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359217.898705:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788359217.898745:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898762:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359217.898781:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898787:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000268d95f2/0x49dd053b5feae120 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae127 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898798:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359217.898801:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898806:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d9eb0fbd already unused, calling callback (00000000e798e4a8) 10000000:00010000:0.0:1788359217.898815:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898821:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359217.898827:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359217.898831:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788359217.898845:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898851:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359217.898856:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898860:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: 00000000d9eb0fbd/0x49dd053b5feae032 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae039 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.898873:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359217.898875:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359217.898877:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359217.898888:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445284096:0@lo:103: 00000100:00100000:0.0:1788359217.898926:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359217.898969:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359217.898976:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445284224:0@lo:103: 00000100:00100000:0.0:1788359217.898997:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359217.899028:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284096 00000100:00100000:0.0:1788359217.899033:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284096 00000100:00100000:1.0:1788359217.899041:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284224 00000100:00100000:1.0:1788359217.899047:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284224 00010000:00010000:0.0:1788359217.899062:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 14 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359217.899065:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 14 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359217.899177:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359217.899276:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359217.899284:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab33e06c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3642:x1875230445284096:12345-0@lo:103: 00010000:00010000:0.0:1788359217.899296:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359217.899301:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 14 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899311:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 14 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899327:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359217.899358:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab33e06c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3642:x1875230445284096:12345-0@lo:103: Request processed in 77us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359217.899366:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359217.899380:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359217.899385:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c70f17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3642:x1875230445284224:12345-0@lo:103: 00010000:00010000:0.0:1788359217.899392:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359217.899395:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 13 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899404:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 13 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899415:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899423:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899446:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899452:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899457:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899462:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899467:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb54ba5d already unused, calling callback (00000000117919a9) 00010000:00010000:0.0:1788359217.899470:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899477:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899484:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359217.899492:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359217.899542:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c70f17 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3642:x1875230445284224:12345-0@lo:103: Request processed in 157us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359217.899549:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788359217.902007:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000603abbfa/0x49dd053b5feae127 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae120 expref: 12 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359217.902031:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076025325 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875230445283840:0@lo:104: 00010000:00010000:2.0:1788359217.902063:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000062377ec9/0x49dd053b5feae039 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae032 expref: 11 pid: 6509 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359217.902073:0:7918:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f64f3fca pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875230445283968:0@lo:104: 00010000:00010000:2.0:1788359217.902097:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.902106:0:7918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.902111:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359217.902116:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb54ba5d/0x49dd053b5feae158 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359217.904555:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cdadb5a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445284224:0@lo:103: 00000100:00100000:1.0:1788359217.904574:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000066699239 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445284096:0@lo:103: 10000000:01000000:3.0:1788359218.046200:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788359218.046206:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaf6cef800 from 4 10000000:01000000:3.0:1788359218.046210:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359218.046259:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.046271:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.046280:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359218.046302:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000078b58b9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284352:0@lo:101: 00000100:00100000:3.0:1788359218.046388:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.046435:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 000000001c2d3254 going to sleep for 11 seconds 00000100:00100000:0.0:1788359218.046836:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284352 00000100:00100000:0.0:1788359218.046845:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284352 00000100:00100000:0.0:1788359218.046998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788359218.047008:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dea6ef6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:6512:x1875230445284352:12345-0@lo:101: 00010000:00010000:0.0:1788359218.047028:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359218.047043:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d2cc5107/0x49dd053b5feae166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae15f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.047065:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d2cc5107/0x49dd053b5feae166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae15f expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.047074:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d2cc5107/0x49dd053b5feae166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae15f expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.047083:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d2cc5107, rc 0) 00000100:00100000:0.0:1788359218.047144:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dea6ef6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445284352:12345-0@lo:101: Request processed in 137us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.047150:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788359218.047223:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000078b58b9e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284352:0@lo:101: 00010000:00010000:1.0:1788359218.047239:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.047257:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359218.047323:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087382855 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284480:0@lo:256: 00000100:00100000:1.0:1788359218.047370:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359218.053317:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 0000000079ae4791 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.056787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284480 00000100:00100000:3.0:1788359218.056801:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284480 00000100:00100000:3.0:1788359218.056854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788359218.056863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea885484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445284480:12345-0@lo:256: 20000000:01000000:3.0:1788359218.056889:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788359218.056909:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788359218.056913:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788359218.057051:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea885484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445284480:12345-0@lo:256: Request processed in 188us (9679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.057059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359218.057237:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087382855 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284480:0@lo:256: 10000000:01000000:1.0:1788359218.057436:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788359218.057445:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.057458:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: 000000003ce68b17/0x49dd053b5feae15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359218.057468:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788359218.057470:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6cef800 from 1 10000000:01000000:1.0:1788359218.057473:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788359218.057660:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: 00000000ad876d49/0x49dd053b5feae16d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.057669:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: 00000000ad876d49/0x49dd053b5feae16d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.057678:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: 00000000ad876d49/0x49dd053b5feae16d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359218.057696:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087382855 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284608:0@lo:101: 00000100:00100000:1.0:1788359218.057733:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359218.057776:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2cb2698 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.057922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284608 00000100:00100000:3.0:1788359218.057926:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284608 00000100:00100000:3.0:1788359218.058049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788359218.058056:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fe6e56c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+12:6512:x1875230445284608:12345-0@lo:101: 00010000:00010000:3.0:1788359218.058066:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359218.058079:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069d1fdd9/0x49dd053b5feae174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae16d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.058457:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069d1fdd9/0x49dd053b5feae174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae16d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.058468:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069d1fdd9/0x49dd053b5feae174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae16d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.058478:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069d1fdd9, rc 0) 00000100:00100000:3.0:1788359218.058546:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fe6e56c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445284608:12345-0@lo:101: Request processed in 491us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.058564:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788359218.058611:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087382855 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284608:0@lo:101: 00010000:00010000:3.0:1788359218.058624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: 00000000ad876d49/0x49dd053b5feae16d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.058632:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: 00000000ad876d49/0x49dd053b5feae16d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359218.058696:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d18b321 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284736:0@lo:501: 00000100:00100000:3.0:1788359218.058721:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.058735:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e24d8e6d going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.058747:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284736 00000100:00100000:3.0:1788359218.058763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284736 00000100:00100000:3.0:1788359218.058782:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359218.058786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e37c2bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445284736:12345-0@lo:501: 00000100:00100000:3.0:1788359218.058888:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e37c2bc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445284736:12345-0@lo:501: Request processed in 101us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.058895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359218.058923:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d18b321 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284736:0@lo:501: 00000100:00100000:3.0:1788359218.058948:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d18b321 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284864:0@lo:503: 00000100:00100000:3.0:1788359218.058987:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.058998:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e24d8e6d going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.059008:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284864 00000100:00100000:3.0:1788359218.059011:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284864 00000100:00100000:3.0:1788359218.059025:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359218.059029:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061b6a5f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445284864:12345-0@lo:503: 00000100:00100000:3.0:1788359218.059220:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061b6a5f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445284864:12345-0@lo:503: Request processed in 190us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.059227:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359218.059273:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d18b321 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445284864:0@lo:503: 00000100:00100000:2.0:1788359218.065029:0:7930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f64f3fca pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7930:1875230445284992:0@lo:502: 00000100:00100000:2.0:1788359218.065136:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.065177:0:7930:0:(client.c:2702:ptlrpc_set_wait()) set 0000000024780390 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.065413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445284992 00000100:00100000:3.0:1788359218.065422:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445284992 00000100:00100000:3.0:1788359218.065475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788359218.065483:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009743e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7930:x1875230445284992:12345-0@lo:502: 00000100:00100000:3.0:1788359218.065630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009743e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7930:x1875230445284992:12345-0@lo:502: Request processed in 147us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.065637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788359218.065949:0:7930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f64f3fca pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7930:1875230445284992:0@lo:502: 00000020:01000000:2.0:1788359218.065981:0:7930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359218.065991:0:7930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359218.065994:0:7930:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788359218.066000:0:7930:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaf6cef800 00000020:00000080:2.0:1788359218.066003:0:7930:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359218.066045:0:7930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7930:1875230445285120:0@lo:502: 00000100:00100000:2.0:1788359218.066098:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.066121:0:7930:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.066220:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285120 00000100:00100000:3.0:1788359218.066224:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285120 00000100:00100000:3.0:1788359218.066267:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788359218.066274:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7930:x1875230445285120:12345-0@lo:502: 00000100:00100000:2.0:1788359218.066510:0:7930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7930:1875230445285120:0@lo:502: 00000020:01000000:2.0:1788359218.066536:0:7930:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359218.066540:0:7930:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359218.066542:0:7930:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788359218.066545:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:3.0:1788359218.066703:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:7930:x1875230445285120:12345-0@lo:502: Request processed in 427us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.066711:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:01000000:3.0:1788359218.066744:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788359218.066777:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359218.066787:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.066797:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359218.066807:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788359218.066815:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eae4e42000 from 21 10000000:01000000:3.0:1788359218.066818:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788359218.066843:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.066851:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.066860:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359218.066872:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285248:0@lo:101: 00000100:00100000:3.0:1788359218.066901:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.066922:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.066965:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285248 00000100:00100000:2.0:1788359218.066969:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285248 00000100:00100000:2.0:1788359218.066999:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788359218.067005:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:6512:x1875230445285248:12345-0@lo:101: 00010000:00010000:2.0:1788359218.067014:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359218.067026:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae17b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.067046:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae17b expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.067056:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae17b expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.067064:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40000, rc 0) 00000100:00100000:2.0:1788359218.067104:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285248:12345-0@lo:101: Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.067109:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788359218.067135:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285248:0@lo:101: 00010000:00010000:2.0:1788359218.067146:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.067155:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.067208:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285376:0@lo:501: 00000100:00100000:2.0:1788359218.067229:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.067241:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.067417:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285376 00000100:00100000:2.0:1788359218.067422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285376 00000100:00100000:2.0:1788359218.067444:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359218.067450:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285376:12345-0@lo:501: 00000100:00100000:2.0:1788359218.067594:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285376:12345-0@lo:501: Request processed in 142us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.067601:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359218.067632:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285376:0@lo:501: 00000100:00100000:2.0:1788359218.067660:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285504:0@lo:503: 00000100:00100000:2.0:1788359218.067698:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.067711:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.067722:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285504 00000100:00100000:2.0:1788359218.067725:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285504 00000100:00100000:2.0:1788359218.067746:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359218.067763:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285504:12345-0@lo:503: 00000100:00100000:2.0:1788359218.067831:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285504:12345-0@lo:503: Request processed in 80us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.067837:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359218.067874:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285504:0@lo:503: 00000100:00100000:2.0:1788359218.068058:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7931:1875230445285632:0@lo:502: 00000100:00100000:2.0:1788359218.068104:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.068129:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285632 00000100:00100000:2.0:1788359218.068133:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285632 00000100:00100000:2.0:1788359218.068155:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788359218.068161:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7931:x1875230445285632:12345-0@lo:502: 00000100:00100000:2.0:1788359218.068234:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:7931:x1875230445285632:12345-0@lo:502: Request processed in 72us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.068241:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788359218.068545:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.068560:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7931:1875230445285632:0@lo:502: 00000100:00100000:3.0:1788359218.068602:0:7931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7931:1875230445285760:0@lo:502: 00000100:00100000:3.0:1788359218.068636:0:7931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.068656:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285760 00000100:00100000:3.0:1788359218.068660:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285760 00000100:00100000:3.0:1788359218.068677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788359218.068683:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7931:x1875230445285760:12345-0@lo:502: 00000100:00100000:3.0:1788359218.068770:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:7931:x1875230445285760:12345-0@lo:502: Request processed in 86us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.068777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788359218.068807:0:7931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.068818:0:7931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7931:1875230445285760:0@lo:502: 00000040:00080000:3.0:1788359218.068836:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788359218.069196:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788359218.069218:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359218.069227:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.069236:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359218.070238:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359218.070253:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eae4e42000 from 4 10000000:01000000:2.0:1788359218.070258:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359218.070295:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070304:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070312:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.070329:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285888:0@lo:101: 00000100:00100000:2.0:1788359218.070386:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.070414:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.070446:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445285888 00000100:00100000:2.0:1788359218.070452:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445285888 00000100:00100000:2.0:1788359218.070486:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788359218.070509:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445285888:12345-0@lo:101: 00010000:00010000:2.0:1788359218.070520:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359218.070531:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae189 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070556:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae189 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070566:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae189 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070575:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40200, rc 0) 00000100:00100000:2.0:1788359218.070609:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445285888:12345-0@lo:101: Request processed in 116us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.070616:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788359218.070647:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445285888:0@lo:101: 00010000:00010000:2.0:1788359218.070659:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070666:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.070707:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286016:0@lo:256: 00000100:00100000:2.0:1788359218.070732:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.070743:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.070766:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286016 00000100:00100000:2.0:1788359218.070774:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286016 00000100:00100000:2.0:1788359218.070796:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788359218.070800:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445286016:12345-0@lo:256: 20000000:01000000:2.0:1788359218.070813:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788359218.070828:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788359218.070830:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788359218.070900:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445286016:12345-0@lo:256: Request processed in 99us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.070907:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788359218.070935:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286016:0@lo:256: 10000000:01000000:2.0:1788359218.070971:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359218.070976:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.070984:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359218.070991:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788359218.070993:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788359218.070995:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788359218.071008:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071014:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071022:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.071032:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286144:0@lo:101: 00000100:00100000:2.0:1788359218.071059:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.071071:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.071080:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286144 00000100:00100000:2.0:1788359218.071083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286144 00000100:00100000:2.0:1788359218.071098:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788359218.071103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445286144:12345-0@lo:101: 00010000:00010000:2.0:1788359218.071109:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359218.071116:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae197 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071128:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae197 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071136:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae197 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071143:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40a00, rc 0) 00000100:00100000:2.0:1788359218.071167:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445286144:12345-0@lo:101: Request processed in 64us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.071172:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788359218.071194:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286144:0@lo:101: 00010000:00010000:2.0:1788359218.071202:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.071208:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.071248:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286272:0@lo:501: 00000100:00100000:2.0:1788359218.071278:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.071289:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.071298:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286272 00000100:00100000:2.0:1788359218.071301:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286272 00000100:00100000:2.0:1788359218.071316:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788359218.071321:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445286272:12345-0@lo:501: 00000100:00100000:2.0:1788359218.071414:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445286272:12345-0@lo:501: Request processed in 92us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.071420:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788359218.071445:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286272:0@lo:501: 00000100:00100000:2.0:1788359218.071469:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286400:0@lo:503: 00000100:00100000:2.0:1788359218.071525:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.071538:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.071549:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286400 00000100:00100000:2.0:1788359218.071552:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286400 00000100:00100000:2.0:1788359218.071570:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788359218.071575:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445286400:12345-0@lo:503: 00000100:00100000:2.0:1788359218.071655:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445286400:12345-0@lo:503: Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.071661:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788359218.071700:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445286400:0@lo:503: 00000100:00100000:2.0:1788359218.071890:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7932:1875230445286528:0@lo:502: 00000100:00100000:2.0:1788359218.071923:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.071941:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286528 00000100:00100000:2.0:1788359218.071944:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286528 00000100:00100000:2.0:1788359218.071965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788359218.071976:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:7932:x1875230445286528:12345-0@lo:502: 00000100:00100000:2.0:1788359218.072045:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:7932:x1875230445286528:12345-0@lo:502: Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.072051:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788359218.072079:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.072091:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7932:1875230445286528:0@lo:502: 00000020:01000000:2.0:1788359218.072110:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359218.072120:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359218.072122:0:7932:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788359218.072126:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788359218.072129:0:7932:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:00000080:2.0:1788359218.072150:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359218.072175:0:7932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffffa0eafef7cd40) 00000020:00000080:2.0:1788359218.072194:0:7932:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788359218.072199:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788359218.072275:0:7932:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788359218.072281:0:7932:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788359218.072288:0:7932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feae1ac 00010000:00080000:2.0:1788359218.072318:0:7932:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaf95e4800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:2.0:1788359218.075888:0:7932:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788359218.081829:0:7932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788359218.081845:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788359218.081882:0:7932:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788359218.081905:0:7932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae1b3 00000100:00080000:3.0:1788359218.081916:0:7932:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359218.081922:0:7932:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa0eaf95e4800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359218.081958:0:7932:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b8a80 x1875230445286656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359218.082013:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445286656:0@lo:38: 00000100:00100000:1.0:1788359218.082105:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788359218.082227:0:7932:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:3.0:1788359218.082282:0:7932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788359218.082434:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286656 00000100:00100000:0.0:1788359218.082442:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286656 00000100:00100000:0.0:1788359218.082476:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359218.082484:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875230445286656:12345-0@lo:38: 00010000:00080000:0.0:1788359218.082527:0:6521:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1788359218.082561:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae1ba 00000004:00100000:0.0:1788359218.082577:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788359218.082583:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788359218.083024:0:7935:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffffa0eb006b3100 x1875230445286784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359218.083034:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead202f0c0 going to sleep for 0 seconds 00000020:01000000:3.0:1788359218.083184:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359218.083191:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359218.083193:0:7932:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788359218.083196:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359218.083200:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359218.083201:0:7932:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788359218.083204:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788359218.083206:0:7932:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788359218.083230:0:7932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7932:1875230445286912:0@lo:502: 00000100:00100000:3.0:1788359218.083428:0:7932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.083458:0:7932:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359218.083521:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286912 00000100:00100000:0.0:1788359218.083526:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286912 00000100:00100000:0.0:1788359218.083563:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788359218.083577:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:7932:x1875230445286912:12345-0@lo:502: 00000100:00100000:0.0:1788359218.083690:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:7932:x1875230445286912:12345-0@lo:502: Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.083697:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788359218.083809:0:7932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7932:1875230445286912:0@lo:502: 00000020:01000000:3.0:1788359218.083834:0:7932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359218.083838:0:7932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359218.083840:0:7932:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788359218.083843:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788359218.083989:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788359218.084013:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788359218.084023:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.084034:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359218.084043:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788359218.084045:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eae4e42000 from 1 10000000:01000000:0.0:1788359218.084048:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359218.084073:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.084081:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359218.084102:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359218.084116:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287040:0@lo:101: 00000100:00100000:0.0:1788359218.084147:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359218.084171:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf21e5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.084322:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287040 00000100:00100000:3.0:1788359218.084327:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287040 00000100:00100000:3.0:1788359218.084430:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359218.084439:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445287040:12345-0@lo:101: 00010000:00010000:3.0:1788359218.084454:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359218.084467:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae1c1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.084489:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.084525:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.084534:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217e000, rc 0) 00000100:00100000:3.0:1788359218.084570:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445287040:12345-0@lo:101: Request processed in 132us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.084576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359218.084608:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287040:0@lo:101: 00010000:00010000:3.0:1788359218.084621:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.084629:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359218.084679:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287168:0@lo:501: 00000100:00100000:3.0:1788359218.084705:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.084720:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.084732:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287168 00000100:00100000:3.0:1788359218.084736:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287168 00000100:00100000:3.0:1788359218.084773:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788359218.084781:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445287168:12345-0@lo:501: 00000100:00100000:3.0:1788359218.084884:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445287168:12345-0@lo:501: Request processed in 104us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.084892:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788359218.084922:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287168:0@lo:501: 00000100:00100000:3.0:1788359218.084948:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287296:0@lo:503: 00000100:00100000:3.0:1788359218.084982:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.084995:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.085006:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287296 00000100:00100000:3.0:1788359218.085011:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287296 00000100:00100000:3.0:1788359218.085035:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788359218.085040:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445287296:12345-0@lo:503: 00000100:00100000:2.0:1788359218.085533:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445287424:0@lo:400: 00000100:00100000:1.0:1788359218.085707:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445287680:0@lo:400: 00000100:00100000:0.0:1788359218.085744:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445287552:0@lo:400: 00000100:00100000:2.0:1788359218.085839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.085877:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287424 00000100:00100000:2.0:1788359218.085882:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287424 00000100:00100000:2.0:1788359218.085916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359218.085923:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445287424:12345-0@lo:400: 00000100:00100000:2.0:1788359218.085965:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445287424:12345-0@lo:400: Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.085983:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788359218.086017:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ead2751880 x1875230445287424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359218.086028:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445287424:0@lo:400: 00000100:00100000:3.0:1788359218.086186:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445287296:12345-0@lo:503: Request processed in 1143us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.086193:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788359218.086415:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445287296:0@lo:503: 00000100:00100000:1.0:1788359218.086490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.086670:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287680 00000100:00100000:2.0:1788359218.086676:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287680 00000100:00100000:2.0:1788359218.086708:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359218.086715:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445287680:12345-0@lo:400: 00000100:00100000:2.0:1788359218.086767:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445287680:12345-0@lo:400: Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.086774:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788359218.086832:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ead2753b80 x1875230445287680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359218.086842:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445287680:0@lo:400: 00000100:00100000:2.0:1788359218.087310:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7936:1875230445287808:0@lo:502: 00000100:00100000:2.0:1788359218.087419:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.087449:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead202f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359218.087518:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287808 00000100:00100000:1.0:1788359218.087523:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287808 00000100:00100000:1.0:1788359218.087556:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788359218.087563:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:7936:x1875230445287808:12345-0@lo:502: 00000100:00100000:1.0:1788359218.087674:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:7936:x1875230445287808:12345-0@lo:502: Request processed in 110us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359218.087681:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788359218.087783:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7936:1875230445287808:0@lo:502: 00000020:01000000:2.0:1788359218.087806:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359218.087815:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359218.087817:0:7936:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788359218.087824:0:7936:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eae4e42000 00000020:00000080:2.0:1788359218.087827:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359218.087848:0:7936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7936:1875230445287936:0@lo:502: 00000100:00100000:2.0:1788359218.087886:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.087917:0:7936:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359218.087959:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287936 00000100:00100000:1.0:1788359218.087964:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287936 00000100:00100000:1.0:1788359218.087994:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788359218.088001:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:7936:x1875230445287936:12345-0@lo:502: 00000100:00100000:1.0:1788359218.088064:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:7936:x1875230445287936:12345-0@lo:502: Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359218.088070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788359218.088325:0:7936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:7936:1875230445287936:0@lo:502: 00000020:01000000:2.0:1788359218.088419:0:7936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359218.088424:0:7936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359218.088426:0:7936:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788359218.088429:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788359218.088648:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788359218.088672:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359218.088682:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.088694:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359218.088705:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788359218.088708:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0eaf5930000 from 1 10000000:01000000:3.0:1788359218.088711:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788359218.088738:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.088773:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359218.088783:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359218.088797:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445288064:0@lo:101: 00000100:00100000:3.0:1788359218.088833:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.088862:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccdddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359218.088903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288064 00000100:00100000:1.0:1788359218.088908:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288064 00000100:00100000:1.0:1788359218.088944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788359218.088951:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445288064:12345-0@lo:101: 00010000:00010000:1.0:1788359218.088960:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359218.088971:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae1cf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.088992:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.089015:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359218.089024:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057000, rc 0) 00000100:00100000:1.0:1788359218.089066:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445288064:12345-0@lo:101: Request processed in 116us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359218.089072:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788359218.089238:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445288064:0@lo:101: 00010000:00010000:2.0:1788359218.089321:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.089331:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.089439:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445288192:0@lo:501: 00000100:00100000:2.0:1788359218.089464:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.089484:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead202f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359218.089592:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288192 00000100:00100000:1.0:1788359218.089597:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288192 00000100:00100000:1.0:1788359218.089628:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788359218.089635:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445288192:12345-0@lo:501: 00000100:00100000:1.0:1788359218.089714:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445288192:12345-0@lo:501: Request processed in 78us (248us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788359218.089721:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788359218.089811:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445288192:0@lo:501: 10000000:01000000:2.0:1788359218.089832:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788359218.089838:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359218.089846:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359218.092068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359218.092235:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788359218.092315:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788359218.092821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445287552 00000100:00100000:0.0:1788359218.092830:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445287552 00000100:00100000:2.0:1788359218.092993:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359218.093004:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445287552:12345-0@lo:400: 00000100:00100000:2.0:1788359218.093186:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445287552:12345-0@lo:400: Request processed in 184us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.093195:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359218.093321:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445287552:0@lo:400: 00000100:00080000:2.0:1788359218.099389:0:6521:0:(import.c:65:import_set_state_nolock()) ffffa0eae4d1a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359218.099489:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445286656:12345-0@lo:38: Request processed in 17003us (17382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.099525:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359218.099572:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359218.099583:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788359218.099591:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788359218.099596:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788359218.099599:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e4800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788359218.099625:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008675463d): req@ffffa0eb006b3100 x1875230445286784/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359218.099641:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445286656:0@lo:38: 00000100:00100000:0.0:1788359218.099985:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359218.100027:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead202f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.100030:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445286784 00000100:00100000:3.0:1788359218.100037:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445286784 00000100:00100000:3.0:1788359218.100100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359218.100109:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445286784:12345-0@lo:1000: 00000100:00100000:3.0:1788359218.100194:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445286784:12345-0@lo:1000: Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.100201:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359218.100430:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b3100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445286784:0@lo:1000: 00000040:01000000:1.0:1788359218.100461:0:7935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788359218.100675:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288320:0@lo:1000: 00000100:00100000:0.0:1788359218.100716:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445288448:0@lo:41: 00000100:00100000:1.0:1788359218.100728:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.100781:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288320 00000100:00100000:3.0:1788359218.100787:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288320 00000100:00100000:3.0:1788359218.100818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359218.100825:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288320:12345-0@lo:1000: 00000100:00100000:3.0:1788359218.101238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288320:12345-0@lo:1000: Request processed in 412us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.101407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359218.101489:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288448 00000100:00100000:2.0:1788359218.101517:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288448 00000100:00100000:2.0:1788359218.101558:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359218.101566:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875230445288448:12345-0@lo:41: 00000004:00000024:2.0:1788359218.101590:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788359218.101632:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875230445288448:12345-0@lo:41: Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359218.101639:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788359218.101694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788359218.101785:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445288448:0@lo:41: 00000100:00100000:1.0:1788359218.103077:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc5290c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359218.103117:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288320:0@lo:1000: 00000100:00100000:1.0:1788359218.103195:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288576:0@lo:700: 00000100:00100000:1.0:1788359218.103242:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359218.104380:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc529840 going to sleep for 11 seconds 00000100:00100000:0.0:1788359218.104635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288576 00000100:00100000:0.0:1788359218.104642:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288576 00000100:00100000:0.0:1788359218.104692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359218.104699:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288576:12345-0@lo:700: 00000100:00100000:0.0:1788359218.104790:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288576:12345-0@lo:700: Request processed in 91us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.104798:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359218.105004:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288576:0@lo:700: 00000100:00100000:3.0:1788359218.105187:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288704:0@lo:1000: 00000100:00100000:3.0:1788359218.105223:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.105844:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359218.105920:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288704 00000100:00100000:0.0:1788359218.105926:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288704 00000100:00100000:0.0:1788359218.106011:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359218.106020:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288704:12345-0@lo:1000: 00000100:00100000:0.0:1788359218.106109:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288704:12345-0@lo:1000: Request processed in 89us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.106115:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788359218.106166:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288704:0@lo:1000: 00000004:00080000:1.0:1788359218.106216:0:7935:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa0eaccddd000 with version 0 00000020:00100000:1.0:1788359218.106236:0:7935:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788359218.106258:0:7935:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa0ead2753480 x1875230445288960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359218.106276:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288960:0@lo:1000: 00000100:00100000:1.0:1788359218.106308:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359218.106863:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc5290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359218.106923:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445288960 00000100:00100000:3.0:1788359218.106928:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445288960 00000100:00100000:3.0:1788359218.106960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359218.106967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7935:x1875230445288960:12345-0@lo:1000: 00000001:00080000:0.0:1788359218.110792:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788359218.110806:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788359218.111120:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7935:x1875230445288960:12345-0@lo:1000: Request processed in 4148us (4805us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788359218.111131:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788359218.111405:0:7935:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788359218.111411:0:7935:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788359218.111427:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445288960:0@lo:1000: 00000100:00100000:1.0:1788359218.111791:0:7935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445289088:0@lo:1000: 00000100:00100000:1.0:1788359218.111830:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359218.111895:0:7935:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc529300 going to sleep for 11 seconds 00000100:00100000:0.0:1788359218.111936:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289088 00000100:00100000:0.0:1788359218.111942:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289088 00000100:00100000:0.0:1788359218.112081:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788359218.112115:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7935:x1875230445289088:12345-0@lo:1000: 00000100:00100000:0.0:1788359218.112195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7935:x1875230445289088:12345-0@lo:1000: Request processed in 87us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359218.112202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788359218.112262:0:7935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7935:1875230445289088:0@lo:1000: 00000040:00080000:1.0:1788359218.112279:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788359218.112315:0:7935:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffffa0eacc5290c0 with version 1 00000040:00080000:1.0:1788359218.114643:0:7935:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788359218.114725:0:7935:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788359218.114741:0:7935:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:3.0:1788359218.115397:0:7933:0:(osp_trans.c:1336:osp_get_next_request()) ou ffffa0eaf6cb5f00 version 1 rpc_version 1 00000020:00100000:3.0:1788359218.115431:0:7933:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788359218.115442:0:7933:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa0ead27bbb80 x1875230445289344/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788359218.115466:0:7933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7933:1875230445289344:0@lo:1000: 00000100:00100000:3.0:1788359218.115554:0:7933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.115938:0:7933:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead15d1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359218.116054:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289344 00000100:00100000:2.0:1788359218.116062:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289344 00000100:00100000:2.0:1788359218.116155:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359218.116164:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7933:x1875230445289344:12345-0@lo:1000: 00000001:00080000:2.0:1788359218.126121:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788359218.126446:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7933:x1875230445289344:12345-0@lo:1000: Request processed in 10277us (10886us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788359218.126458:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1788359218.126599:0:7933:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788359218.126604:0:7933:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788359218.126623:0:7933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7933:1875230445289344:0@lo:1000: 00010000:00010000:0.0:1788359218.561439:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359218.882222:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445289472:0@lo:41: 00000100:00100000:2.0:1788359218.882301:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359218.882416:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289472 00000100:00100000:3.0:1788359218.882425:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289472 00000100:00100000:3.0:1788359218.882481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788359218.882489:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445289472:12345-0@lo:41: 00000004:00000024:3.0:1788359218.882544:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788359218.882607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445289472:12345-0@lo:41: Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359218.882615:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359218.882736:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445289472:0@lo:41: 00010000:00010000:1.0:1788359219.588866:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359220.604663:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359221.633371:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359222.655668:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359223.484820:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445289600:0@lo:400: 00000100:00100000:0.0:1788359223.484890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.484935:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445290112:0@lo:400: 00000100:00100000:0.0:1788359223.484963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.485285:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359223.485292:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445289984:0@lo:400: 00000100:00100000:0.0:1788359223.485320:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.485360:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445289728:0@lo:400: 00000100:00100000:0.0:1788359223.485385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.485404:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359223.485409:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445289856:0@lo:400: 00000100:00100000:0.0:1788359223.485430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.485462:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289600 00000100:00100000:0.0:1788359223.485469:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289600 00000100:00100000:0.0:1788359223.485542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788359223.485552:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3645:x1875230445289600:12345-0@lo:400: 00000100:00100000:0.0:1788359223.485601:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3645:x1875230445289600:12345-0@lo:400: Request processed in 51us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.485608:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788359223.485639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289984 00000100:00100000:0.0:1788359223.485650:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289984 00000100:00100000:0.0:1788359223.485676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289728 00000100:00100000:0.0:1788359223.485679:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289728 00000100:00100000:0.0:1788359223.485713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359223.485721:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445289984:12345-0@lo:400: 00000100:00100000:0.0:1788359223.485753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445289984:12345-0@lo:400: Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.485758:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359223.485769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359223.485774:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445289728:12345-0@lo:400: 00000100:00100000:0.0:1788359223.485910:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445289728:12345-0@lo:400: Request processed in 135us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.485916:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359223.485934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290112 00000100:00100000:0.0:1788359223.485937:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290112 00000100:00100000:0.0:1788359223.485958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445289856 00000100:00100000:0.0:1788359223.485961:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445289856 00000100:00100000:0.0:1788359223.485974:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359223.486047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445290112:12345-0@lo:400: 00000100:00100000:0.0:1788359223.486083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445290112:12345-0@lo:400: Request processed in 38us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.486089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359223.486100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359223.486105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445289856:12345-0@lo:400: 00000100:00100000:0.0:1788359223.486130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445289856:12345-0@lo:400: Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.486136:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359223.486179:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445289856:0@lo:400: 00010000:00080000:0.0:1788359223.486198:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0eb006b1500 x1875230445289728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359223.486209:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445289728:0@lo:400: 00010000:00080000:0.0:1788359223.486236:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0eb006b2680 x1875230445289984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359223.486245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445289984:0@lo:400: 00000100:00100000:0.0:1788359223.486252:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445289600:0@lo:400: 00000100:00100000:0.0:1788359223.486259:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445290112:0@lo:400: 00000100:00100000:3.0:1788359223.486476:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359223.486579:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445290240:0@lo:41: 00000100:00100000:3.0:1788359223.486610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359223.486841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290240 00000100:00100000:0.0:1788359223.486846:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290240 00000100:00100000:0.0:1788359223.486908:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359223.486915:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445290240:12345-0@lo:41: 00000004:00000024:0.0:1788359223.486941:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788359223.486998:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445290240:12345-0@lo:41: Request processed in 83us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359223.487004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359223.487060:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445290240:0@lo:41: 00010000:00010000:2.0:1788359223.679180:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359223.998395:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445290368:0@lo:41: 00000100:00100000:0.0:1788359223.998469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359223.998708:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290368 00000100:00100000:3.0:1788359223.998720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290368 00000100:00100000:3.0:1788359223.998885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359223.998894:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445290368:12345-0@lo:41: 00000004:00000024:3.0:1788359223.998936:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788359223.998979:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445290368:12345-0@lo:41: Request processed in 86us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359223.998985:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788359223.999085:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445290368:0@lo:41: 00010000:00010000:1.0:1788359224.707090:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359225.725454:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359226.753423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788359226.815132:0:8424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788359226.815137:0:8424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788359226.815138:0:8424:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788359226.815301:0:8424:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0eaf6d76800 00000020:01000004:3.0:1788359226.815319:0:8424:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788359226.815331:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359226.815345:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0eae4d819c0) 00000020:00000080:3.0:1788359226.815363:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788359226.888202:0:8424:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788359226.888266:0:8424:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788359226.949962:0:8424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788359226.950192:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788359226.950204:0:8424:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788359226.950218:0:8424:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49dd053b5feae1e4 00000020:01000004:3.0:1788359226.950224:0:8424:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788359226.950246:0:8424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788359226.950250:0:8424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788359226.950256:0:8424:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788359226.950261:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788359226.950271:0:8424:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0eae4d83380) 00000020:00000080:3.0:1788359226.950283:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788359226.956533:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359226.957389:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788359226.957395:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788359226.962071:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788359226.962086:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788359226.972087:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788359226.972106:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788359226.981487:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359226.982833:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788359226.982843:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788359226.992707:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788359226.992727:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788359227.062255:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359227.062515:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788359227.062522:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788359227.066789:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788359227.066803:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788359227.069751:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788359227.069766:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788359227.075220:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359227.075407:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788359227.075414:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788359227.076277:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788359227.076285:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788359227.121719:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359227.124039:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788359227.124056:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788359227.126730:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788359227.126746:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788359227.127312:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788359227.127344:0:8424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788359227.127350:0:8424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788359227.161037:0:8424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788359227.161077:0:8424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.152@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788359227.161081:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788359227.161083:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788359227.161085:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359227.161086:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359227.161087:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359227.161089:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359227.161091:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359227.161092:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359227.161094:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359227.161095:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359227.161096:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359227.161100:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788359227.161103:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359227.161104:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788359227.161105:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359227.161107:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359227.161108:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359227.161109:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359227.161110:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359227.161111:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788359227.161112:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788359227.161113:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359227.161114:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359227.161139:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788359227.161157:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445290496:0@lo:253: 00000100:00100000:2.0:1788359227.161241:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.161299:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.161571:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290496 00000100:00100000:3.0:1788359227.161579:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290496 00000100:00100000:3.0:1788359227.161646:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788359227.161657:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:8424:x1875230445290496:12345-0@lo:253: 20000000:01000000:3.0:1788359227.161713:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788359227.161718:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788359227.161724:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788359227.161727:0:6510:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788359227.162020:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359227.162153:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788359227.162168:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788359227.162185:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788359227.162191:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788359227.162212:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788359227.162227:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788359227.162312:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788359227.162326:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:3.0:1788359227.162328:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788359227.162343:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788359227.162349:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788359227.162361:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788359227.162367:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:3.0:1788359227.162381:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788359227.162387:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788359227.162400:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788359227.162413:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788359227.162475:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1788359227.162485:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:3.0:1788359227.162486:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788359227.162673:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1788359227.162681:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788359227.162697:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1788359227.162703:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:3.0:1788359227.162716:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1788359227.162721:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788359227.162733:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1788359227.162825:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1788359227.163206:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1788359227.163219:0:6510:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:3.0:1788359227.163221:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:3.0:1788359227.163235:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1788359227.163240:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788359227.163253:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1788359227.163258:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:3.0:1788359227.163280:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1788359227.163288:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788359227.163301:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1788359227.163315:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1788359227.163328:0:6510:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788359227.163330:0:6510:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788359227.163334:0:6510:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788359227.163376:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788359227.163379:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788359227.168889:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788359227.174867:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788359227.174905:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788359227.174921:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788359227.174932:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788359227.174935:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788359227.177871:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788359227.177931:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788359227.177949:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788359227.179706:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788359227.179740:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788359227.179871:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788359227.179885:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788359227.179888:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788359227.180740:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788359227.180782:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788359227.180798:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788359227.181042:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788359227.181063:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788359227.181077:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788359227.181087:0:6510:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788359227.181089:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788359227.187629:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788359227.187709:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788359227.187733:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788359227.188167:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788359227.188212:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788359227.188230:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788359227.188247:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788359227.188267:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188284:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188302:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae12e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188309:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae17b expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188315:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae197 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188321:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188329:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188367:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188384:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 18 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.188398:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290624:0@lo:104: 00000100:00100000:3.0:1788359227.188457:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359227.188595:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188603:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.188611:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290752:0@lo:104: 00000100:00100000:3.0:1788359227.188638:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359227.188855:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.188864:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.188872:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290880:0@lo:104: 00000100:00100000:3.0:1788359227.188894:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359227.188922:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290624 00000100:00100000:1.0:1788359227.188928:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290624 00000100:00100000:1.0:1788359227.188964:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290752 00000100:00100000:1.0:1788359227.188966:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290752 00000100:00100000:1.0:1788359227.188979:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359227.188986:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445290624:12345-0@lo:104: 00010000:00010000:1.0:1788359227.188999:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189062:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359227.189069:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445290624:12345-0@lo:104: Request processed in 82us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.189083:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359227.189100:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359227.189106:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6510:x1875230445290752:12345-0@lo:104: 00010000:00010000:1.0:1788359227.189114:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189151:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359227.189155:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6510:x1875230445290752:12345-0@lo:104: Request processed in 51us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.189161:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788359227.189178:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359227.189183:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189191:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217fe00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359227.189195:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189203:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359227.189211:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359227.189216:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359227.189248:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189255:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359227.189280:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189288:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb0217fe00/0x49dd053b5feae1cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1d6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189301:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359227.189304:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189310:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359227.189312:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189319:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359227.189325:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359227.189330:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359227.189343:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189347:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359227.189352:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189358:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae19e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.189367:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359227.189374:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359227.189376:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359227.189523:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359227.189608:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291008:0@lo:103: 00000100:00100000:1.0:1788359227.189651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359227.189699:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359227.189705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291136:0@lo:103: 00000100:00100000:1.0:1788359227.189725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.189833:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291008 00000100:00100000:2.0:1788359227.189838:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291008 00010000:00010000:2.0:1788359227.189861:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 19 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.189881:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291136 00000100:00100000:2.0:1788359227.189883:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291136 00010000:00010000:2.0:1788359227.189892:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 20 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.189907:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359227.189913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3644:x1875230445291008:12345-0@lo:103: 00010000:00010000:2.0:1788359227.189924:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359227.189928:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 20 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.189937:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 20 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.189951:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359227.189984:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3644:x1875230445291008:12345-0@lo:103: Request processed in 71us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.189990:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359227.190003:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359227.190091:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3644:x1875230445291136:12345-0@lo:103: 00010000:00010000:2.0:1788359227.190102:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359227.190112:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 19 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.190120:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 19 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.190129:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359227.190151:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3644:x1875230445291136:12345-0@lo:103: Request processed in 142us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.190157:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359227.190190:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291136:0@lo:103: 00000100:00100000:2.0:1788359227.190200:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291008:0@lo:103: 00010000:00010000:3.0:1788359227.190515:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.190526:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 18 pid: 6508 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.190536:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445291264:0@lo:104: 00000100:00100000:3.0:1788359227.190562:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359227.190725:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.190733:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 18 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.190742:0:6510:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445291392:0@lo:104: 00000100:00100000:3.0:1788359227.190857:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359227.191135:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445290880 00000100:00100000:1.0:1788359227.191142:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445290880 00000100:00100000:1.0:1788359227.191169:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291264 00000100:00100000:1.0:1788359227.191172:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291264 00000100:00100000:1.0:1788359227.191185:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788359227.191192:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445290880:12345-0@lo:104: 00010000:00010000:1.0:1788359227.191202:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.191285:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359227.191291:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445290880:12345-0@lo:104: Request processed in 99us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.191298:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788359227.191312:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359227.191318:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6510:x1875230445291264:12345-0@lo:104: 00010000:00010000:1.0:1788359227.191326:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191412:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788359227.191419:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191425:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217e200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359227.191429:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191438:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359227.191445:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359227.191450:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788359227.191483:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191529:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359227.191543:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191550:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e200/0x49dd053b5feae17b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191563:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359227.191566:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191571:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359227.191574:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191580:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359227.191585:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359227.191590:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788359227.191601:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191605:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359227.191609:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191614:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae135 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.191629:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359227.191631:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359227.191632:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359227.191711:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445291520:0@lo:103: 00000100:00100000:0.0:1788359227.191742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.191786:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359227.191792:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445291648:0@lo:103: 00000100:00100000:0.0:1788359227.191830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.191859:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291520 00000100:00100000:0.0:1788359227.191862:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291520 00010000:00010000:0.0:1788359227.191879:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 19 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.191897:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291648 00000100:00100000:0.0:1788359227.191900:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291648 00010000:00010000:0.0:1788359227.191911:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 20 pid: 6508 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.191926:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359227.191932:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3642:x1875230445291520:12345-0@lo:103: 00010000:00010000:0.0:1788359227.191941:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359227.191945:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 20 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.191954:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 20 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.191967:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359227.191991:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3642:x1875230445291520:12345-0@lo:103: Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.191997:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359227.193604:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359227.193627:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3642:x1875230445291648:12345-0@lo:103: 00010000:00010000:0.0:1788359227.193643:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359227.193651:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 19 pid: 6508 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.193691:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 19 pid: 6508 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.193707:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359227.193766:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3642:x1875230445291648:12345-0@lo:103: Request processed in 150us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.193896:0:6510:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984da80 going to sleep for 11 seconds 00010000:00010000:3.0:1788359227.193922:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae1d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae1cf expref: 19 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.193936:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290624:0@lo:104: 00010000:00010000:3.0:1788359227.193959:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae197 expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.193970:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290752:0@lo:104: 00010000:00010000:3.0:1788359227.193980:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40000/0x49dd053b5feae182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae17b expref: 17 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.193988:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445290880:0@lo:104: 00010000:00010000:3.0:1788359227.193997:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae12e expref: 16 pid: 6508 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.194006:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445291264:0@lo:104: 00000100:00100000:0.0:1788359227.194200:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359227.194240:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445291648:0@lo:103: 00000100:00100000:0.0:1788359227.194249:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445291520:0@lo:103: 00000100:00100000:0.0:1788359227.194276:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788359227.194284:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788359227.194723:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291392 00000100:00100000:0.0:1788359227.194731:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291392 00000100:00100000:3.0:1788359227.194925:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359227.194934:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445291392:12345-0@lo:104: 00010000:00010000:3.0:1788359227.194948:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.195415:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359227.195423:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6510:x1875230445291392:12345-0@lo:104: Request processed in 491us (4565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.195430:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788359227.195481:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359227.195489:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195534:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359227.195538:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195547:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359227.195554:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359227.195559:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788359227.195596:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195602:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359227.195618:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195624:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02057e00/0x49dd053b5feae0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae0be expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195638:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359227.195648:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359227.195650:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359227.195705:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291776:0@lo:103: 00000100:00100000:2.0:1788359227.195760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.195806:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291776 00000100:00100000:2.0:1788359227.195811:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291776 00010000:00010000:2.0:1788359227.195830:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 15 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.195851:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359227.195858:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3644:x1875230445291776:12345-0@lo:103: 00010000:00010000:2.0:1788359227.195868:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359227.195873:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 15 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195884:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 15 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195901:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195910:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195924:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195931:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195937:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195948:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195953:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea5000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359227.195956:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195963:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195971:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.195980:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359227.196009:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3644:x1875230445291776:12345-0@lo:103: Request processed in 151us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.196588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359227.196654:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445291776:0@lo:103: 00010000:00010000:0.0:1788359227.197359:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae0b7 expref: 14 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.197377:0:6510:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6510:1875230445291392:0@lo:104: 00010000:00010000:0.0:1788359227.197478:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.197488:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.197575:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.197582:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae1f2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788359227.197612:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1788359227.197821:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359227.197862:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788359227.197873:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6510:x1875230445291264:12345-0@lo:104: Request processed in 6553us (7308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.197891:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359227.207302:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:8424:x1875230445290496:12345-0@lo:253: Request processed in 45637us (46051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.207318:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788359227.207479:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445290496:0@lo:253: 10000000:01000000:2.0:1788359227.207583:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788359227.207588:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788359227.207591:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788359227.207592:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359227.207594:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788359227.207595:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359227.207596:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359227.207598:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359227.207600:0:8424:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788359227.207602:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359227.207603:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788359227.207647:0:8424:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0eaf6d76800 from lustre-OST0000 10000000:01000000:2.0:1788359227.207692:0:8424:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788359227.207696:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788359227.207704:0:8424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0eaf5930000 local copy 10000000:01000000:2.0:1788359227.207708:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788359227.207871:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.207884:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.207894:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.207981:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445291904:0@lo:101: 00000100:00100000:2.0:1788359227.208100:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.210159:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359227.211588:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445291904 00000100:00100000:0.0:1788359227.211603:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445291904 00000100:00100000:0.0:1788359227.211720:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788359227.211731:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:8424:x1875230445291904:12345-0@lo:101: 00010000:00010000:0.0:1788359227.211761:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359227.211782:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031e00/0x49dd053b5feae200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae1f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.211811:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031e00/0x49dd053b5feae200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae1f9 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.211821:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031e00/0x49dd053b5feae200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae1f9 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.211831:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031e00, rc 0) 00000100:00100000:2.0:1788359227.213071:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445291904:0@lo:101: 00010000:00010000:2.0:1788359227.213097:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.213108:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.213245:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292032:0@lo:501: 00000100:00100000:2.0:1788359227.213294:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.213338:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445291904:12345-0@lo:101: Request processed in 180us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.213349:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788359227.214219:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359227.214368:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292032 00000100:00100000:0.0:1788359227.214375:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292032 00000100:00100000:0.0:1788359227.214417:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788359227.214425:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292032:12345-0@lo:501: 00000100:00100000:0.0:1788359227.214536:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292032:12345-0@lo:501: Request processed in 111us (1242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359227.214556:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788359227.214695:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292032:0@lo:501: 10000000:01000000:2.0:1788359227.214711:0:8424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788359227.214737:0:8424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788359227.214860:0:8424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.214872:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.214879:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.214907:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788359227.214948:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eaf6d76800 10000000:01000000:2.0:1788359227.214953:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788359227.214959:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788359227.214961:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788359227.214965:0:8424:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788359227.214968:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788359227.214992:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.214999:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.215006:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359227.215021:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292160:0@lo:101: 00000100:00100000:2.0:1788359227.215053:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.215066:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142240 going to sleep for 11 seconds 00010000:00010000:0.0:1788359227.215155:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359227.215162:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215180:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359227.215184:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215192:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359227.215199:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359227.215205:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359227.215223:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215229:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359227.215256:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215263:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae200 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215278:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359227.215280:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359227.215281:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359227.215290:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359227.215308:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445292288:0@lo:103: 00000100:00100000:0.0:1788359227.215335:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.215362:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292288 00000100:00100000:0.0:1788359227.215366:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292288 00000100:00100000:0.0:1788359227.215409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359227.215416:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3644:x1875230445292288:12345-0@lo:103: 00010000:00010000:0.0:1788359227.215426:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359227.215439:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031e00/0x49dd053b5feae200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae1f9 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215454:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359227.215485:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:3644:x1875230445292288:12345-0@lo:103: Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.215491:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359227.215559:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445292288:0@lo:103: 00000100:00100000:0.0:1788359227.215586:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292160 00000100:00100000:0.0:1788359227.215589:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292160 00000100:00100000:0.0:1788359227.215605:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788359227.215611:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+13:8424:x1875230445292160:12345-0@lo:101: 00010000:00010000:0.0:1788359227.215619:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359227.215633:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae207 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215649:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae207 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215659:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae207 expref: 14 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.215688:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0030200, rc 0) 00000100:00100000:0.0:1788359227.215719:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292160:12345-0@lo:101: Request processed in 109us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.215725:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788359227.216050:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292160:0@lo:101: 00010000:00010000:0.0:1788359227.216064:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.216073:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.216181:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292416:0@lo:501: 00000100:00100000:0.0:1788359227.216209:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.216233:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292416 00000100:00100000:0.0:1788359227.216237:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292416 00000100:00100000:0.0:1788359227.216254:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788359227.216259:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292416:12345-0@lo:501: 00000100:00100000:0.0:1788359227.216346:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292416:12345-0@lo:501: Request processed in 86us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.216352:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788359227.216374:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359227.216397:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292416:0@lo:501: 00000100:00100000:0.0:1788359227.216423:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292544:0@lo:503: 00000100:00100000:0.0:1788359227.216458:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.216474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292544 00000100:00100000:0.0:1788359227.216481:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292544 00000100:00100000:0.0:1788359227.216531:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788359227.216537:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292544:12345-0@lo:503: 00000100:00100000:0.0:1788359227.216607:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292544:12345-0@lo:503: Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.216613:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788359227.216645:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359227.216657:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292544:0@lo:503: 00000040:00080000:0.0:1788359227.217357:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359227.217684:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292672:0@lo:502: 00000100:00100000:0.0:1788359227.218133:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.218265:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.218486:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292672 00000100:00100000:3.0:1788359227.218514:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292672 00000100:00100000:3.0:1788359227.218554:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788359227.218562:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292672:12345-0@lo:502: 00000100:00100000:3.0:1788359227.218689:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292672:12345-0@lo:502: Request processed in 128us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.218703:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788359227.218941:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292672:0@lo:502: 00000040:00080000:0.0:1788359227.219336:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788359227.219368:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788359227.219455:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788359227.219472:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788359227.219483:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788359227.219512:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788359227.219543:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292800:0@lo:502: 00000100:00100000:0.0:1788359227.219591:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.219611:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.220120:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292800 00000100:00100000:3.0:1788359227.220128:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292800 00000100:00100000:3.0:1788359227.220162:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788359227.220241:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292800:12345-0@lo:502: 00000100:00100000:3.0:1788359227.220356:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292800:12345-0@lo:502: Request processed in 117us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.220364:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788359227.220707:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292800:0@lo:502: 00000040:00080000:0.0:1788359227.220903:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788359227.220992:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788359227.223593:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788359227.223608:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788359227.223616:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359227.223618:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788359227.223626:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359227.223650:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0e9c561cd40) 00000020:00000080:3.0:1788359227.223688:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788359227.223695:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788359227.223878:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaf6d76800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788359227.223888:0:8448:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788359227.223895:0:8448:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49dd053b5feae21c 00010000:00010000:3.0:1788359227.236086:0:8448:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788359227.236603:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788359227.241356:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788359227.242138:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788359227.249701:0:8448:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788359227.250005:0:8448:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788359227.258426:0:8448:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788359227.261159:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788359227.261319:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359227.261327:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359227.261329:0:8448:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788359227.261332:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359227.261336:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359227.261337:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788359227.261340:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359227.261342:0:8448:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788359227.261366:0:8448:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359227.261369:0:8448:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359227.261370:0:8448:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788359227.261372:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788359227.265863:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788359227.266565:0:8424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788359227.266647:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.266674:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359227.266684:0:8424:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6d76800 from 1 10000000:01000000:0.0:1788359227.266687:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359227.266730:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.266739:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.266764:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.266791:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292928:0@lo:101: 00000100:00100000:0.0:1788359227.266866:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.266934:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571900 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.269815:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445292928 00000100:00100000:3.0:1788359227.269833:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445292928 00000100:00100000:3.0:1788359227.269897:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359227.269919:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445292928:12345-0@lo:101: 00010000:00010000:3.0:1788359227.269936:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359227.269955:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae223 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.269992:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae223 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.270004:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae223 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.270013:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4800, rc 0) 00000100:00100000:3.0:1788359227.270089:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445292928:12345-0@lo:101: Request processed in 182us (3223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.270097:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788359227.270357:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445292928:0@lo:101: 00010000:00010000:0.0:1788359227.270375:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.270384:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.270526:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293056:0@lo:501: 00000100:00100000:0.0:1788359227.270564:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.270605:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571900 going to sleep for 11 seconds 00000100:00100000:2.0:1788359227.272157:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293056 00000100:00100000:2.0:1788359227.272178:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293056 00000100:00100000:2.0:1788359227.272224:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359227.272233:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293056:12345-0@lo:501: 00000100:00100000:2.0:1788359227.272411:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293056:12345-0@lo:501: Request processed in 177us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.272418:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359227.272660:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293056:0@lo:501: 00000100:00100000:2.0:1788359227.272718:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293184:0@lo:503: 00000100:00100000:2.0:1788359227.272828:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.274043:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.277283:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293184 00000100:00100000:3.0:1788359227.277304:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293184 00000100:00100000:3.0:1788359227.277419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359227.277430:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293184:12345-0@lo:503: 00000100:00100000:3.0:1788359227.277625:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293184:12345-0@lo:503: Request processed in 196us (4795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.277633:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359227.279612:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293184:0@lo:503: 00000040:00080000:3.0:1788359227.280261:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788359227.280363:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293312:0@lo:502: 00000100:00100000:3.0:1788359227.280438:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359227.280485:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c01780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.280531:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293312 00000100:00100000:3.0:1788359227.280537:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293312 00000100:00100000:3.0:1788359227.280577:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359227.280587:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293312:12345-0@lo:502: 00000100:00100000:3.0:1788359227.280720:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293312:12345-0@lo:502: Request processed in 133us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.280728:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359227.281077:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293312:0@lo:502: 00000040:00080000:3.0:1788359227.281431:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788359227.281459:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788359227.281482:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293440:0@lo:502: 00000100:00100000:3.0:1788359227.281702:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359227.281795:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c01780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359227.281890:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293440 00000100:00100000:1.0:1788359227.281896:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293440 00000100:00100000:1.0:1788359227.282048:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788359227.282058:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293440:12345-0@lo:502: 00000100:00100000:2.0:1788359227.282296:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293440:0@lo:502: 00000040:00080000:2.0:1788359227.282350:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788359227.282362:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:1.0:1788359227.282583:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293440:12345-0@lo:502: Request processed in 108us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.282592:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000020:01000000:2.0:1788359227.283119:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359227.283129:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359227.283132:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788359227.283139:0:8452:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaf6d76800 00000020:00000080:2.0:1788359227.283141:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788359227.283153:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359227.283156:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359227.283157:0:8452:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788359227.283160:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788359227.283385:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788359227.283413:0:8424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359227.283439:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.283452:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359227.283525:0:8424:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788359227.283528:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eaf6d76800 10000000:01000000:0.0:1788359227.283530:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eaf6d76800 10000000:01000000:0.0:1788359227.283534:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359227.283540:0:8424:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6d76800 from 1 10000000:01000000:0.0:1788359227.283543:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359227.283573:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.283581:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.283590:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.283609:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293568:0@lo:101: 00000100:00100000:0.0:1788359227.283655:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.284022:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.284233:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293568 00000100:00100000:3.0:1788359227.284240:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293568 00000100:00100000:3.0:1788359227.284278:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788359227.284288:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8424:x1875230445293568:12345-0@lo:101: 00010000:00010000:3.0:1788359227.284301:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359227.284315:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae231 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.284337:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae231 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.284347:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae231 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.284354:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:3.0:1788359227.284403:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293568:12345-0@lo:101: Request processed in 117us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.284409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359227.286859:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293568:0@lo:101: 00010000:00010000:0.0:1788359227.286892:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.287083:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.287226:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293696:0@lo:501: 00000100:00100000:0.0:1788359227.287285:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.287331:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.287454:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293696 00000100:00100000:3.0:1788359227.287469:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293696 00000100:00100000:3.0:1788359227.287535:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788359227.287545:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293696:12345-0@lo:501: 00000100:00100000:3.0:1788359227.287684:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293696:12345-0@lo:501: Request processed in 141us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.287692:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788359227.288050:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293696:0@lo:501: 00000100:00100000:0.0:1788359227.288079:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293824:0@lo:503: 00000100:00100000:0.0:1788359227.288118:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.288146:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.288246:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293824 00000100:00100000:3.0:1788359227.288251:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293824 00000100:00100000:3.0:1788359227.288283:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788359227.288289:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293824:12345-0@lo:503: 00000100:00100000:3.0:1788359227.288369:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293824:12345-0@lo:503: Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.288376:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359227.288472:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293824:0@lo:503: 00000040:00080000:0.0:1788359227.288978:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359227.289070:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293952:0@lo:502: 00000100:00100000:0.0:1788359227.289115:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.289151:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.289284:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445293952 00000100:00100000:3.0:1788359227.289289:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445293952 00000100:00100000:3.0:1788359227.289329:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788359227.289337:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293952:12345-0@lo:502: 00000100:00100000:3.0:1788359227.289432:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445293952:12345-0@lo:502: Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.289440:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788359227.289594:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445293952:0@lo:502: 00000040:00080000:0.0:1788359227.290296:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788359227.290331:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788359227.290343:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788359227.290355:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788359227.290366:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788359227.290376:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788359227.290387:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788359227.290397:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788359227.290408:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788359227.290419:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788359227.290438:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788359227.290448:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788359227.290458:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788359227.290470:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788359227.290484:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788359227.291415:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788359227.291475:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788359227.292382:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788359227.292424:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788359227.292440:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788359227.292453:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788359227.292467:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788359227.292480:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788359227.292899:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788359227.293141:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788359227.293160:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788359227.293642:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788359227.293658:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788359227.293684:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788359227.293698:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788359227.293711:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788359227.293723:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788359227.295654:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788359227.295703:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788359227.295718:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788359227.295731:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788359227.295744:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788359227.297312:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445294080:0@lo:502: 00000100:00100000:0.0:1788359227.297407:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.297814:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359227.300537:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294080 00000100:00100000:3.0:1788359227.300552:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294080 00000100:00100000:3.0:1788359227.300615:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788359227.300626:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445294080:12345-0@lo:502: 00000100:00100000:3.0:1788359227.300835:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445294080:12345-0@lo:502: Request processed in 210us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.300843:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788359227.301481:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445294080:0@lo:502: 00000040:00080000:0.0:1788359227.301617:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788359227.301632:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788359227.302653:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788359227.302683:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0eafed7b380) 00000020:00000080:1.0:1788359227.302712:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788359227.303136:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaf6d76800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359227.303141:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaf6d76800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359227.303144:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6d76800 3 00010000:00080000:1.0:1788359227.303289:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c5598800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359227.310487:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788359227.310644:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788359227.310712:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788359227.310727:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x49dd053b5feae246 00000100:00080000:1.0:1788359227.310738:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359227.310744:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0e9c5598800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359227.310783:0:8453:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c55a4380 x1875230445294208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359227.310808:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788359227.312549:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445294464:0@lo:400: 00000100:00100000:0.0:1788359227.312626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.312693:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359227.312701:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445294336:0@lo:400: 00000100:00100000:0.0:1788359227.312740:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.312787:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445294592:0@lo:400: 00000100:00100000:0.0:1788359227.312809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.312829:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359227.312834:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445294720:0@lo:400: 00000100:00100000:0.0:1788359227.312852:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.312884:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294464 00000100:00100000:0.0:1788359227.312891:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294464 00000100:00100000:0.0:1788359227.313144:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294720 00000100:00100000:0.0:1788359227.313148:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294720 00000100:00100000:0.0:1788359227.313177:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788359227.313186:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445294464:12345-0@lo:400: 00000100:00100000:3.0:1788359227.313319:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445294208:0@lo:38: 00000100:00100000:3.0:1788359227.313354:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.313732:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445294464:12345-0@lo:400: Request processed in 546us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.313740:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788359227.313864:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788359227.313872:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445294720:12345-0@lo:400: 00000100:00100000:0.0:1788359227.313979:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445294720:12345-0@lo:400: Request processed in 38us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.313988:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788359227.314015:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294336 00000100:00100000:0.0:1788359227.314028:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294336 00000100:00100000:3.0:1788359227.314192:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445294464:0@lo:400: 00000100:00100000:0.0:1788359227.314369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294592 00000100:00100000:0.0:1788359227.314374:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294592 00000100:00100000:0.0:1788359227.314391:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294208 00000100:00100000:0.0:1788359227.314394:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294208 00000100:00100000:0.0:1788359227.314405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359227.314411:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445294336:12345-0@lo:400: 00000100:00100000:0.0:1788359227.314461:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445294336:12345-0@lo:400: Request processed in 50us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.314468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359227.314482:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359227.314487:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445294592:12345-0@lo:400: 00000100:00100000:0.0:1788359227.314538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445294592:12345-0@lo:400: Request processed in 51us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.314544:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359227.314555:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359227.314560:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445294208:12345-0@lo:38: 00010000:00080000:0.0:1788359227.314587:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1788359227.314626:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x49dd053b5feae24d 00000004:00100000:0.0:1788359227.314644:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788359227.314689:0:6515:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f6c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359227.314734:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875230445294208:12345-0@lo:38: Request processed in 172us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359227.314740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788359227.314905:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0eb006b1500 x1875230445294336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359227.314927:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445294336:0@lo:400: 00000020:01000004:1.0:1788359227.315196:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788359227.315384:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffffa0eafed7cd40) 00000020:00000080:1.0:1788359227.315405:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788359227.315636:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaf6d76800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359227.315641:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaf6d76800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359227.315644:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6d76800 3 00010000:00080000:1.0:1788359227.315685:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaf243a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.152@tcp at head 00010000:00080000:0.0:1788359227.316587:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c55a4380 x1875230445294208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359227.316599:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359227.316616:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788359227.316624:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788359227.316629:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788359227.316632:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788359227.316639:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445294208:0@lo:38: 00000100:00100000:0.0:1788359227.316691:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445294720:0@lo:400: 00010000:00080000:0.0:1788359227.316704:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0eb006b1f80 x1875230445294592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359227.316713:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445294592:0@lo:400: 00010000:00010000:1.0:1788359227.330331:0:8453:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788359227.330470:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788359227.330537:0:8453:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788359227.330554:0:8453:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x49dd053b5feae25b 00000100:00080000:1.0:1788359227.330567:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359227.330573:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffffa0eaf243a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359227.330614:0:8453:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c55a5180 x1875230445294848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359227.330644:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788359227.331877:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445294848:0@lo:38: 00000100:00100000:0.0:1788359227.331967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359227.332953:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294848 00000100:00100000:1.0:1788359227.332965:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294848 00000100:00100000:1.0:1788359227.333012:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359227.333022:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445294848:12345-0@lo:38: 00000040:00080000:0.0:1788359227.333652:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788359227.333730:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788359227.333775:0:8424:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359227.333792:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359227.333803:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788359227.333860:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788359227.333862:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788359227.333863:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359227.333864:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359227.333866:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359227.333867:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359227.333868:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359227.333870:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359227.333871:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359227.333879:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359227.333880:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359227.333885:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788359227.333888:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788359227.333889:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788359227.333890:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359227.333890:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359227.333891:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359227.333892:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359227.333893:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359227.333894:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359227.333894:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359227.333895:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359227.333896:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359227.333936:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788359227.333957:0:8424:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445294976:0@lo:253: 00000100:00100000:0.0:1788359227.334028:0:8424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359227.334074:0:8424:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571d80 going to sleep for 11 seconds 00010000:00080000:1.0:1788359227.334558:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:1.0:1788359227.334620:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x49dd053b5feae262 00000004:00100000:1.0:1788359227.334638:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788359227.334703:0:6515:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6314000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359227.335303:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875230445294848:12345-0@lo:38: Request processed in 2278us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.335314:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788359227.335375:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c55a5180 x1875230445294848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359227.335387:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359227.335395:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788359227.335403:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788359227.335407:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788359227.335410:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf243a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359227.335415:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445294848:0@lo:38: 00000100:00100000:2.0:1788359227.335540:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445294976 00000100:00100000:2.0:1788359227.335547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445294976 00000100:00100000:2.0:1788359227.335590:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359227.335598:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:8424:x1875230445294976:12345-0@lo:253: 20000000:01000000:2.0:1788359227.335632:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788359227.335645:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788359227.346186:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788359227.346219:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788359227.346517:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788359227.346523:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788359227.346545:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346567:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae15f expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346575:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346584:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346630:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346659:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359227.346688:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445295104:0@lo:104: 00000100:00100000:1.0:1788359227.346771:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788359227.346820:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.346827:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 16 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359227.346836:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445295232:0@lo:104: 00000100:00100000:1.0:1788359227.346852:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf58c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359227.348243:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788359227.348282:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359227.348320:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295104 00000100:00100000:2.0:1788359227.348328:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295104 00000100:00100000:2.0:1788359227.348368:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295232 00000100:00100000:2.0:1788359227.348371:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295232 00000100:00100000:2.0:1788359227.348384:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359227.348391:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445295104:12345-0@lo:104: 00010000:00010000:2.0:1788359227.348407:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.348462:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788359227.348468:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445295104:12345-0@lo:104: Request processed in 78us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.348474:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359227.348530:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788359227.348536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445295232:12345-0@lo:104: 00010000:00010000:2.0:1788359227.348543:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359227.348765:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445295104:0@lo:104: 00000100:00100000:1.0:1788359227.348776:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445295232:0@lo:104: 00010000:00010000:1.0:1788359227.348799:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359227.349717:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788359227.349728:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445295232:12345-0@lo:104: Request processed in 1190us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359227.349736:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1788359227.350441:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359227.350451:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350463:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359227.350467:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350476:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359227.350483:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359227.350489:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359227.350556:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350563:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359227.350581:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350587:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40400/0x49dd053b5feae189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae190 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350615:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359227.350618:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350623:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217f600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359227.350626:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350632:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359227.350637:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359227.350642:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359227.350655:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350660:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359227.350679:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350686:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb0217f600/0x49dd053b5feae15f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.350701:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359227.350703:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359227.350704:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359227.350722:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445295488:0@lo:103: 00000100:00100000:3.0:1788359227.350793:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359227.350841:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359227.350848:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445295360:0@lo:103: 00000100:00100000:3.0:1788359227.350867:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359227.350899:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295488 00000100:00100000:3.0:1788359227.350904:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295488 00010000:00010000:3.0:1788359227.350940:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 17 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.350962:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295360 00000100:00100000:3.0:1788359227.350965:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295360 00010000:00010000:3.0:1788359227.350976:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 18 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359227.350991:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788359227.350999:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3643:x1875230445295488:12345-0@lo:103: 00010000:00010000:3.0:1788359227.351328:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359227.351336:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351345:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351359:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0030800/0x49dd053b5feae166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae15f expref: 18 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351373:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359227.351408:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:3643:x1875230445295488:12345-0@lo:103: Request processed in 410us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.351415:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788359227.351440:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359227.351446:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3643:x1875230445295360:12345-0@lo:103: 00010000:00010000:3.0:1788359227.351455:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359227.351459:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351468:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351477:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae189 expref: 16 pid: 6510 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351488:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351518:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788359227.351532:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005756717s 00010000:00010000:3.0:1788359227.351536:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351542:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351548:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351554:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351559:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359227.351569:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351577:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351599:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359227.351608:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359227.351631:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3643:x1875230445295360:12345-0@lo:103: Request processed in 185us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359227.351636:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359227.351689:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445295360:0@lo:103: 00000100:00100000:3.0:1788359227.351698:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445295488:0@lo:103: 00010000:00010000:2.0:1788359227.353598:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359227.354354:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:8424:x1875230445294976:12345-0@lo:253: Request processed in 18750us (20319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359227.354370:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00010000:1.0:1788359227.354423:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.354444:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359227.354458:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae269 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359227.356539:0:8424:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8424:1875230445294976:0@lo:253: 10000000:01000000:0.0:1788359227.356568:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788359227.356572:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359227.356577:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788359227.356578:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359227.356582:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359227.356583:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359227.356585:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359227.356586:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359227.356591:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359227.356592:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359227.356597:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359227.356598:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788359227.356630:0:8424:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788359227.368607:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788359227.368793:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788359227.368980:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788359227.369135:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788359227.369627:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788359227.369882:0:8424:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788359227.373153:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788359227.410171:0:8424:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788359227.410181:0:8424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788359227.410298:0:8424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788359227.410351:0:8424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788359227.410374:0:8424:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788359227.410405:0:8424:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788359227.420479:0:8424:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359227.420749:0:8424:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788359227.776891:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359228.482438:0:8509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359228.483115:0:8509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788359228.606950:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445295616:0@lo:41: 00000100:00100000:1.0:1788359228.607022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359228.610118:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295616 00000100:00100000:0.0:1788359228.610133:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295616 00000100:00100000:0.0:1788359228.610310:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788359228.610320:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445295616:12345-0@lo:41: 00000004:00000024:0.0:1788359228.610365:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788359228.610432:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445295616:12345-0@lo:41: Request processed in 114us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359228.610438:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788359228.614173:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445295616:0@lo:41: 00010000:00010000:2.0:1788359228.797693:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359229.120760:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445295744:0@lo:41: 00000100:00100000:3.0:1788359229.120834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359229.120910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295744 00000100:00100000:3.0:1788359229.120917:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295744 00000100:00100000:3.0:1788359229.120961:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359229.120970:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445295744:12345-0@lo:41: 00000004:00000024:3.0:1788359229.121004:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788359229.121059:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445295744:12345-0@lo:41: Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359229.121067:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359229.121124:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445295744:0@lo:41: 00010000:00010000:3.0:1788359229.820663:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359230.845367:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359231.869776:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359232.702745:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445295872:0@lo:400: 00000100:00100000:0.0:1788359232.702798:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445296000:0@lo:400: 00000100:00100000:1.0:1788359232.702823:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359232.702826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359232.702869:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445296384:0@lo:400: 00000100:00100000:1.0:1788359232.702895:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359232.702937:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445295872 00000100:00100000:1.0:1788359232.702943:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445295872 00000100:00100000:1.0:1788359232.702988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359232.702997:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3642:x1875230445295872:12345-0@lo:400: 00000100:00100000:1.0:1788359232.703043:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:3642:x1875230445295872:12345-0@lo:400: Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359232.703050:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359232.703082:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296384 00000100:00100000:1.0:1788359232.703086:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296384 00000100:00100000:1.0:1788359232.703112:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359232.703117:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445296384:12345-0@lo:400: 00000100:00100000:1.0:1788359232.703149:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445296384:12345-0@lo:400: Request processed in 32us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359232.703168:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359232.703210:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445295872:0@lo:400: 00000100:00100000:1.0:1788359232.703220:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445296384:0@lo:400: 00000100:00100000:1.0:1788359232.703259:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445296256:0@lo:400: 00000100:00100000:1.0:1788359232.703283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359232.703302:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788359232.703307:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445296128:0@lo:400: 00000100:00100000:1.0:1788359232.703326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359232.703339:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445296512:0@lo:400: 00000100:00100000:1.0:1788359232.703341:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445296640:0@lo:400: 00000100:00100000:1.0:1788359232.703358:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359232.703374:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296000 00000100:00100000:0.0:1788359232.703378:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296000 00000100:00100000:1.0:1788359232.703384:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296128 00000100:00100000:1.0:1788359232.703387:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296128 00000100:00100000:0.0:1788359232.703403:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296256 00000100:00100000:1.0:1788359232.703404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788359232.703405:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296256 00000100:00100000:1.0:1788359232.703409:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445296128:12345-0@lo:400: 00000100:00100000:0.0:1788359232.703415:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296640 00000100:00100000:0.0:1788359232.703417:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296640 00000100:00100000:0.0:1788359232.703440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359232.703441:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445296128:12345-0@lo:400: Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359232.703446:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445296000:12345-0@lo:400: 00000100:00100000:1.0:1788359232.703447:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359232.703464:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359232.703471:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445296256:12345-0@lo:400: 00000100:00100000:0.0:1788359232.703474:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445296000:12345-0@lo:400: Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359232.703480:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359232.703512:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788359232.703519:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445296640:12345-0@lo:400: 00000100:00100000:1.0:1788359232.703523:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445296256:12345-0@lo:400: Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359232.703529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788359232.703545:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359232.703546:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445296640:12345-0@lo:400: Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359232.703552:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788359232.703571:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359232.703573:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445296128:0@lo:400: 00010000:00080000:1.0:1788359232.703584:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bca80 x1875230445296640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788359232.703592:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bd180 x1875230445296000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359232.703601:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445296640:0@lo:400: 00000100:00100000:0.0:1788359232.703607:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445296000:0@lo:400: 00010000:00080000:1.0:1788359232.703626:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bea00 x1875230445296256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359232.703635:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445296256:0@lo:400: 00000100:00100000:1.0:1788359232.703660:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296512 00000100:00100000:1.0:1788359232.703664:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296512 00000100:00100000:1.0:1788359232.703687:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788359232.703693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445296512:12345-0@lo:400: 00000100:00100000:1.0:1788359232.703722:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445296512:12345-0@lo:400: Request processed in 28us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359232.703727:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788359232.703741:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788359232.704099:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bf480 x1875230445296512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359232.704109:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445296512:0@lo:400: 00010000:00010000:2.0:1788359232.892710:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359233.728881:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359233.730374:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445296768:0@lo:41: 00000100:00100000:3.0:1788359233.730440:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359233.730570:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296768 00000100:00100000:0.0:1788359233.730579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296768 00000100:00100000:0.0:1788359233.730643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788359233.730653:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445296768:12345-0@lo:41: 00000004:00000024:0.0:1788359233.730689:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788359233.730733:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445296768:12345-0@lo:41: Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359233.730741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788359233.730834:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445296768:0@lo:41: 00010000:00010000:3.0:1788359233.916797:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788359234.214288:0:8799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788359234.240261:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359234.240287:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445296896:0@lo:41: 00000100:00100000:2.0:1788359234.240341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359234.240378:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445296896 00000100:00100000:1.0:1788359234.240385:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445296896 00000100:00100000:1.0:1788359234.240579:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359234.240590:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445296896:12345-0@lo:41: 00000004:00000024:1.0:1788359234.240635:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788359234.243718:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445296896:12345-0@lo:41: Request processed in 3120us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359234.243734:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359234.248333:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445296896:0@lo:41: 00010000:00010000:2.0:1788359234.941607:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359235.423655:0:8851:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359235.423880:0:8851:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788359235.772656:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788359235.772665:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6cef800 from 30 10000000:01000000:2.0:1788359235.772670:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359235.772721:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.772733:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.772744:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.772781:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297024:0@lo:101: 00000100:00100000:2.0:1788359235.773023:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.773106:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.773300:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297024 00000100:00100000:1.0:1788359235.773310:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297024 00000100:00100000:1.0:1788359235.773369:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359235.773379:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:6512:x1875230445297024:12345-0@lo:101: 00010000:00010000:1.0:1788359235.773402:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359235.773415:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae270 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.773440:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae270 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.773450:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae270 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.773460:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057e00, rc 0) 00000100:00100000:1.0:1788359235.773551:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297024:12345-0@lo:101: Request processed in 173us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.773558:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788359235.773994:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297024:0@lo:101: 00010000:00010000:3.0:1788359235.774009:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359235.774018:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359235.774081:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297152:0@lo:501: 00000100:00100000:3.0:1788359235.774111:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.774213:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.774335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297152 00000100:00100000:2.0:1788359235.774341:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297152 00000100:00100000:2.0:1788359235.774382:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788359235.774391:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297152:12345-0@lo:501: 00000100:00100000:2.0:1788359235.774557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297152:12345-0@lo:501: Request processed in 167us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.774565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788359235.776207:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297152:0@lo:501: 00000100:00100000:3.0:1788359235.776268:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297280:0@lo:503: 00000100:00100000:3.0:1788359235.776346:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.776382:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.776808:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297280 00000100:00100000:2.0:1788359235.776816:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297280 00000100:00100000:2.0:1788359235.777010:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788359235.777021:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297280:12345-0@lo:503: 00000100:00100000:2.0:1788359235.777422:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297280:12345-0@lo:503: Request processed in 403us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.777430:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788359235.779622:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297280:0@lo:503: 00000100:00100000:3.0:1788359235.781645:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8871:1875230445297408:0@lo:502: 00000100:00100000:3.0:1788359235.781730:0:8871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.781785:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.782069:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297408 00000100:00100000:1.0:1788359235.782079:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297408 00000100:00100000:1.0:1788359235.782149:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788359235.782158:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8871:x1875230445297408:12345-0@lo:502: 00000100:00100000:1.0:1788359235.782282:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8871:x1875230445297408:12345-0@lo:502: Request processed in 125us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.782290:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788359235.782394:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8871:1875230445297408:0@lo:502: 00000100:00100000:3.0:1788359235.782437:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8871:1875230445297536:0@lo:502: 00000100:00100000:3.0:1788359235.782471:0:8871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.782512:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.782637:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297536 00000100:00100000:1.0:1788359235.782642:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297536 00000100:00100000:1.0:1788359235.782672:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788359235.782678:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8871:x1875230445297536:12345-0@lo:502: 00000100:00100000:1.0:1788359235.782751:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:8871:x1875230445297536:12345-0@lo:502: Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.782757:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788359235.785572:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8871:1875230445297536:0@lo:502: 00000040:00080000:2.0:1788359235.785626:0:8871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788359235.790220:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788359235.790264:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359235.790279:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.790292:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359235.790304:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788359235.790307:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaf6cef800 from 5 10000000:01000000:0.0:1788359235.790310:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788359235.790358:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.790367:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.790388:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359235.790410:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297664:0@lo:101: 00000100:00100000:0.0:1788359235.790476:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.790536:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4d9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.793266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297664 00000100:00100000:2.0:1788359235.793398:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297664 00000100:00100000:2.0:1788359235.793468:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359235.793478:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445297664:12345-0@lo:101: 00010000:00010000:2.0:1788359235.793514:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359235.793533:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae27e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.793560:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.793571:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.793604:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40400, rc 0) 00000100:00100000:2.0:1788359235.793686:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445297664:12345-0@lo:101: Request processed in 210us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.793693:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359235.793785:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297664:0@lo:101: 00010000:00010000:2.0:1788359235.793803:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.793812:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.793880:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297792:0@lo:256: 00000100:00100000:2.0:1788359235.793916:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.793941:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.799317:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297792 00000100:00100000:1.0:1788359235.799335:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297792 00000100:00100000:1.0:1788359235.799419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788359235.799431:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445297792:12345-0@lo:256: 20000000:01000000:1.0:1788359235.799462:0:6508:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788359235.799526:0:6508:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788359235.799530:0:6508:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788359235.799670:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445297792:12345-0@lo:256: Request processed in 241us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.799677:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788359235.800953:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297792:0@lo:256: 10000000:01000000:2.0:1788359235.801025:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359235.801036:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801048:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359235.801058:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788359235.801061:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788359235.801063:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788359235.801108:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801131:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801141:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.801168:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297920:0@lo:101: 00000100:00100000:2.0:1788359235.801222:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.801271:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.801295:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445297920 00000100:00100000:2.0:1788359235.801301:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445297920 00000100:00100000:2.0:1788359235.801339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359235.801348:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445297920:12345-0@lo:101: 00010000:00010000:2.0:1788359235.801360:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359235.801373:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae28c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801396:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae28c expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801408:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae28c expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801417:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40600, rc 0) 00000100:00100000:2.0:1788359235.801458:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445297920:12345-0@lo:101: Request processed in 110us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.801465:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359235.801524:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445297920:0@lo:101: 00010000:00010000:2.0:1788359235.801543:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.801552:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.801618:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298048:0@lo:501: 00000100:00100000:2.0:1788359235.801643:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.801660:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.801670:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298048 00000100:00100000:2.0:1788359235.801673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298048 00000100:00100000:2.0:1788359235.801690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788359235.801696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445298048:12345-0@lo:501: 00000100:00100000:2.0:1788359235.802029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445298048:12345-0@lo:501: Request processed in 332us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.802036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788359235.802068:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298048:0@lo:501: 00000100:00100000:2.0:1788359235.802263:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298176:0@lo:503: 00000100:00100000:2.0:1788359235.802308:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.802333:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.802393:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298176 00000100:00100000:1.0:1788359235.802399:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298176 00000100:00100000:1.0:1788359235.802436:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788359235.802443:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445298176:12345-0@lo:503: 00000100:00100000:1.0:1788359235.802557:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445298176:12345-0@lo:503: Request processed in 113us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.802563:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359235.802918:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298176:0@lo:503: 00000100:00100000:1.0:1788359235.803645:0:8872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8872:1875230445298304:0@lo:502: 00000100:00100000:1.0:1788359235.803704:0:8872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.803736:0:8872:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.803884:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298304 00000100:00100000:2.0:1788359235.803890:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298304 00000100:00100000:2.0:1788359235.803922:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788359235.803930:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:8872:x1875230445298304:12345-0@lo:502: 00000100:00100000:2.0:1788359235.804027:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:8872:x1875230445298304:12345-0@lo:502: Request processed in 98us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.804043:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788359235.804328:0:8872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8872:1875230445298304:0@lo:502: 00000020:01000000:1.0:1788359235.804357:0:8872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788359235.804367:0:8872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788359235.804376:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.804379:0:8872:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788359235.804386:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788359235.804390:0:8872:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:1.0:1788359235.804414:0:8872:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788359235.804423:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788359235.804439:0:8872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffffa0eafed78000) 00000020:00000080:1.0:1788359235.804464:0:8872:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788359235.804471:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788359235.804600:0:8872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788359235.804607:0:8872:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788359235.804615:0:8872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae2a1 00010000:00080000:1.0:1788359235.804646:0:8872:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaff1f7000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359235.804891:0:8872:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788359235.826562:0:8872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788359235.826598:0:8872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788359235.827011:0:8872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359235.827234:0:8872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359235.827323:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788359235.827427:0:8872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788359235.834553:0:8873:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359235.834562:0:8873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788359235.839517:0:8872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788359235.839745:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788359235.839799:0:8872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788359235.839829:0:8872:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae2a8 00000100:00080000:1.0:1788359235.839841:0:8872:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359235.840766:0:8872:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa0eaff1f7000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359235.840806:0:8872:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c55a4a80 x1875230445298432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359235.840828:0:8872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788359235.840980:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445298432:0@lo:8: 00000100:00100000:0.0:1788359235.841064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.841197:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298432 00000100:00100000:0.0:1788359235.841205:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298432 00000100:00100000:0.0:1788359235.841240:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359235.841247:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445298432:12345-0@lo:8: 00010000:00080000:0.0:1788359235.841276:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1788359235.841308:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae2af 00002000:00100000:0.0:1788359235.841348:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffffa0eaf6f6e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788359235.841353:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788359235.841356:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788359235.841428:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:1.0:1788359235.841786:0:8872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359235.841793:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.841795:0:8872:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788359235.841799:0:8872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359235.841803:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.841805:0:8872:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788359235.841808:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359235.841822:0:8872:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788359235.841923:0:8872:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8872:1875230445298560:0@lo:502: 00000100:00100000:1.0:1788359235.841980:0:8872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.842010:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298560 00000100:00100000:1.0:1788359235.842015:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298560 00000100:00100000:1.0:1788359235.842051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788359235.842060:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:8872:x1875230445298560:12345-0@lo:502: 00000100:00100000:1.0:1788359235.842178:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:8872:x1875230445298560:12345-0@lo:502: Request processed in 120us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.842187:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788359235.842227:0:8872:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.842248:0:8872:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8872:1875230445298560:0@lo:502: 00000020:01000000:1.0:1788359235.842274:0:8872:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359235.842278:0:8872:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.842280:0:8872:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788359235.842284:0:8872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1788359235.842333:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788359235.842361:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788359235.842371:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842383:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359235.842394:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788359235.842397:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eae4e42000 from 30 10000000:01000000:1.0:1788359235.842401:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788359235.842423:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842439:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842448:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359235.842474:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298688:0@lo:101: 00000100:00100000:1.0:1788359235.842520:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.842534:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.842546:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298688 00000100:00100000:1.0:1788359235.842549:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298688 00000100:00100000:1.0:1788359235.842571:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788359235.842577:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445298688:12345-0@lo:101: 00010000:00010000:1.0:1788359235.842599:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359235.842611:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae2b6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842633:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842643:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842653:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056400, rc 0) 00000100:00100000:1.0:1788359235.842679:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445298688:12345-0@lo:101: Request processed in 102us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.842685:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788359235.842713:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298688:0@lo:101: 00010000:00010000:1.0:1788359235.842730:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.842740:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359235.842784:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298816:0@lo:501: 00000100:00100000:1.0:1788359235.842808:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.842820:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.842831:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298816 00000100:00100000:1.0:1788359235.842835:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298816 00002000:00080000:0.0:1788359235.844100:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788359235.844134:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f6f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359235.844204:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445298432:12345-0@lo:8: Request processed in 2955us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.844214:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788359235.844267:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a4a80 x1875230445298432/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359235.844280:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359235.844295:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788359235.844303:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788359235.844308:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788359235.844311:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1f7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788359235.844336:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788359235.844343:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445298432:0@lo:8: 00000004:00080000:3.0:1788359235.844489:0:8873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788359235.844594:0:8873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 267815098040ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788359235.844601:0:8873:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788359235.844676:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788359235.844688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445298816:12345-0@lo:501: 00000100:00100000:1.0:1788359235.844818:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445298816:12345-0@lo:501: Request processed in 134us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.844825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788359235.844866:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298816:0@lo:501: 00000100:00100000:1.0:1788359235.844904:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298944:0@lo:503: 00000100:00100000:1.0:1788359235.844947:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.844974:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.844987:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445298944 00000100:00100000:1.0:1788359235.844993:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445298944 00000100:00100000:1.0:1788359235.845015:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788359235.845020:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445298944:12345-0@lo:503: 00000100:00100000:1.0:1788359235.845095:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445298944:12345-0@lo:503: Request processed in 74us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.845101:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788359235.845146:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445298944:0@lo:503: 00000100:00100000:2.0:1788359235.845953:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445299072:0@lo:400: 00000100:00100000:2.0:1788359235.845992:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846015:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445299584:0@lo:400: 00000100:00100000:2.0:1788359235.846040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846057:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359235.846062:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445299456:0@lo:400: 00000100:00100000:2.0:1788359235.846082:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846106:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445299200:0@lo:400: 00000100:00100000:2.0:1788359235.846126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846146:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445299712:0@lo:400: 00000100:00100000:2.0:1788359235.846172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846186:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359235.846190:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445299328:0@lo:400: 00000100:00100000:2.0:1788359235.846208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299072 00000100:00100000:2.0:1788359235.846241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299072 00000100:00100000:2.0:1788359235.846269:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299584 00000100:00100000:2.0:1788359235.846272:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299584 00000100:00100000:2.0:1788359235.846291:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299712 00000100:00100000:2.0:1788359235.846294:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299712 00000100:00100000:2.0:1788359235.846307:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299328 00000100:00100000:2.0:1788359235.846310:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299328 00000100:00100000:2.0:1788359235.846329:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788359235.846335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445299072:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846389:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445299072:12345-0@lo:400: Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846396:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788359235.846410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359235.846416:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445299584:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445299584:12345-0@lo:400: Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359235.846460:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359235.846465:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445299712:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846520:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445299712:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846526:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359235.846538:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359235.846544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445299328:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846570:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445299328:12345-0@lo:400: Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359235.846609:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299456 00000100:00100000:2.0:1788359235.846612:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299456 00000100:00100000:2.0:1788359235.846633:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299200 00000100:00100000:2.0:1788359235.846636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299200 00000100:00100000:2.0:1788359235.846651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359235.846657:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445299456:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445299456:12345-0@lo:400: Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846701:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359235.846712:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359235.846718:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445299200:12345-0@lo:400: 00000100:00100000:2.0:1788359235.846743:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445299200:12345-0@lo:400: Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.846748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788359235.846784:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0ea00 x1875230445299328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.846797:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445299328:0@lo:400: 00000100:00100000:2.0:1788359235.846807:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445299200:0@lo:400: 00010000:00080000:2.0:1788359235.846817:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0c700 x1875230445299712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.846825:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445299712:0@lo:400: 00000100:00100000:2.0:1788359235.846850:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445299456:0@lo:400: 00010000:00080000:2.0:1788359235.846858:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0f480 x1875230445299072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.846865:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445299072:0@lo:400: 00010000:00080000:2.0:1788359235.846872:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0ce00 x1875230445299584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.846880:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445299584:0@lo:400: 00000100:00100000:2.0:1788359235.846916:0:8874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445299840:0@lo:700: 00000100:00100000:2.0:1788359235.846944:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.846965:0:8874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607db40 going to sleep for 11 seconds 00000100:00080000:1.0:1788359235.847134:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359235.847139:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359235.847154:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299840 00000100:00100000:1.0:1788359235.847158:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299840 00000100:00100000:1.0:1788359235.847198:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359235.847205:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8874:x1875230445299840:12345-0@lo:700: 00000100:00100000:1.0:1788359235.847234:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875230445299968:0@lo:700: 00000100:00100000:1.0:1788359235.847266:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.847282:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae554fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.847300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445299968 00000100:00100000:1.0:1788359235.847304:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445299968 00000100:00100000:1.0:1788359235.847328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359235.847335:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875230445299968:12345-0@lo:700: 00000100:00080000:2.0:1788359235.850341:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359235.866168:0:8875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8875:1875230445300096:0@lo:502: 00000100:00100000:0.0:1788359235.866258:0:8875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.866295:0:8875:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4d9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.866392:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300096 00000100:00100000:2.0:1788359235.866400:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300096 00000100:00100000:2.0:1788359235.866450:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788359235.866460:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:8875:x1875230445300096:12345-0@lo:502: 00000100:00100000:2.0:1788359235.866614:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:8875:x1875230445300096:12345-0@lo:502: Request processed in 155us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.866623:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788359235.867479:0:8875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8875:1875230445300096:0@lo:502: 00000100:00100000:0.0:1788359235.867578:0:8875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8875:1875230445300224:0@lo:502: 00000100:00100000:0.0:1788359235.867635:0:8875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.867670:0:8875:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4d9c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.867857:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300224 00000100:00100000:2.0:1788359235.867863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300224 00000100:00100000:2.0:1788359235.867901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788359235.867909:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:8875:x1875230445300224:12345-0@lo:502: 00000100:00100000:2.0:1788359235.867998:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:8875:x1875230445300224:12345-0@lo:502: Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.868006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788359235.869241:0:8875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8875:1875230445300224:0@lo:502: 00000040:00080000:0.0:1788359235.869281:0:8875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788359235.869461:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788359235.869487:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359235.869525:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.869537:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359235.869548:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359235.869550:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eae4e42000 from 5 10000000:01000000:2.0:1788359235.869553:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359235.869597:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.869620:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.869630:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.869649:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300352:0@lo:101: 00000100:00100000:2.0:1788359235.869700:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.869732:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.869799:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300352 00000100:00100000:0.0:1788359235.869806:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300352 00000100:00100000:0.0:1788359235.870879:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788359235.870891:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445300352:12345-0@lo:101: 00010000:00010000:0.0:1788359235.870907:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359235.870924:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae2c4 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.870950:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.870959:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.870979:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031600, rc 0) 00000100:00100000:0.0:1788359235.871043:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445300352:12345-0@lo:101: Request processed in 154us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.871049:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 40000000:02000000:3.0:1788359235.874053:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:2.0:1788359235.875805:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788359235.886392:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300352:0@lo:101: 00010000:00010000:2.0:1788359235.886427:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.886441:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359235.886549:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300480:0@lo:256: 00000100:00100000:2.0:1788359235.886626:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.886663:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.891271:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300480 00000100:00100000:0.0:1788359235.891290:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300480 00000100:00100000:0.0:1788359235.891358:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788359235.891369:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445300480:12345-0@lo:256: 20000000:01000000:0.0:1788359235.891398:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788359235.891425:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788359235.891429:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788359235.891606:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445300480:12345-0@lo:256: Request processed in 238us (4978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.891613:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788359235.891677:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300480:0@lo:256: 10000000:01000000:0.0:1788359235.891734:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788359235.891743:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.891754:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359235.891765:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788359235.891767:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788359235.891769:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788359235.891797:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.891816:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.891825:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359235.891846:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300608:0@lo:101: 00000100:00100000:0.0:1788359235.891880:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.891907:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.891923:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300608 00000100:00100000:0.0:1788359235.891927:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300608 00000100:00100000:0.0:1788359235.891952:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788359235.891959:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445300608:12345-0@lo:101: 00010000:00010000:0.0:1788359235.891967:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359235.891993:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae2d2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.892015:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.892025:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.892034:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a000, rc 0) 00000100:00100000:0.0:1788359235.892062:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445300608:12345-0@lo:101: Request processed in 103us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.892068:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788359235.892095:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300608:0@lo:101: 00010000:00010000:0.0:1788359235.892115:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359235.892124:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359235.892178:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300736:0@lo:501: 00000100:00100000:0.0:1788359235.892200:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.892213:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eb006cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.892223:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300736 00000100:00100000:0.0:1788359235.892226:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300736 00000100:00100000:0.0:1788359235.892245:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788359235.892250:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445300736:12345-0@lo:501: 00000100:00100000:0.0:1788359235.892360:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445300736:12345-0@lo:501: Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.892367:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788359235.892392:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300736:0@lo:501: 00000100:00100000:0.0:1788359235.892417:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300864:0@lo:503: 00000100:00100000:0.0:1788359235.892457:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.892469:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eb006cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.892480:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300864 00000100:00100000:0.0:1788359235.892483:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300864 00000100:00100000:0.0:1788359235.892523:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788359235.892530:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445300864:12345-0@lo:503: 00000100:00100000:0.0:1788359235.892623:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445300864:12345-0@lo:503: Request processed in 93us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.892629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788359235.892666:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445300864:0@lo:503: 00000100:00100000:3.0:1788359235.912103:0:8877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8877:1875230445300992:0@lo:502: 00000100:00100000:3.0:1788359235.912202:0:8877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.912289:0:8877:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.913675:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8439:x1875230445299968:12345-0@lo:700: Request processed in 66325us (66393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.913697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788359235.913867:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a7b80 x1875230445299968/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359235.913884:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8439:1875230445299968:0@lo:700: 40000000:02000000:1.0:1788359235.913896:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788359235.916966:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445300992 00000100:00100000:0.0:1788359235.917054:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445300992 00000100:00100000:0.0:1788359235.917133:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788359235.917144:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:8877:x1875230445300992:12345-0@lo:502: 00000100:00100000:0.0:1788359235.917569:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:8877:x1875230445300992:12345-0@lo:502: Request processed in 426us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.917577:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788359235.918360:0:8877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8877:1875230445300992:0@lo:502: 00000020:01000000:0.0:1788359235.922812:0:8877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788359235.922834:0:8877:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788359235.922851:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359235.922854:0:8877:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788359235.922864:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788359235.922870:0:8877:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:0.0:1788359235.922915:0:8877:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788359235.922919:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788359235.922959:0:8877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0eaffa43380) 00000020:00000080:0.0:1788359235.922997:0:8877:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788359235.923005:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788359235.923106:0:8877:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788359235.923115:0:8877:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788359235.923124:0:8877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feae2e7 00010000:00080000:0.0:1788359235.923171:0:8877:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c559a000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:0.0:1788359235.923627:0:8877:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:1.0:1788359235.944054:0:8877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788359235.944091:0:8877:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000001:00100000:0.0:1788359235.946372:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:1.0:1788359235.947899:0:8877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359235.949641:0:8877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359235.949796:0:8877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788359235.949904:0:8877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788359235.953407:0:8879:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359235.953416:0:8879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788359235.955969:0:8877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359235.955995:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788359235.956058:0:8877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788359235.956084:0:8877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae2ee 00000100:00080000:1.0:1788359235.956094:0:8877:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359235.956101:0:8877:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0e9c559a000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359235.956141:0:8877:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c55a7b80 x1875230445301120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359235.956167:0:8877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788359235.956361:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445301120:0@lo:8: 00000100:00100000:0.0:1788359235.956473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788359235.957835:0:8877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359235.957841:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.957844:0:8877:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788359235.957848:0:8877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359235.957853:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.957854:0:8877:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788359235.957857:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359235.957859:0:8877:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788359235.957899:0:8877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8877:1875230445301248:0@lo:502: 00000100:00100000:1.0:1788359235.957966:0:8877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359235.958002:0:8877:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccd08780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.958031:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301248 00000100:00100000:1.0:1788359235.958036:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301248 00000100:00100000:1.0:1788359235.958075:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788359235.958085:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:8877:x1875230445301248:12345-0@lo:502: 00000100:00100000:3.0:1788359235.959436:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301120 00000100:00100000:3.0:1788359235.959448:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301120 00000100:00100000:3.0:1788359235.959516:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359235.959524:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3641:x1875230445301120:12345-0@lo:8: 00010000:00080000:3.0:1788359235.959568:0:8433:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1788359235.959604:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae2f5 00002000:00100000:3.0:1788359235.959619:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0e9c5604800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788359235.959624:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788359235.959627:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788359235.959704:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:8877:x1875230445301248:12345-0@lo:502: Request processed in 1618us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.959714:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788359235.959784:0:8877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:8877:1875230445301248:0@lo:502: 00000020:01000000:1.0:1788359235.959819:0:8877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359235.959831:0:8877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359235.959833:0:8877:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788359235.959840:0:8877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788359235.959982:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788359235.960007:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788359235.960018:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.960030:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359235.960041:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788359235.960044:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0eaf5930000 from 1 10000000:01000000:1.0:1788359235.960047:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788359235.960078:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.960085:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.960095:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359235.960112:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445301376:0@lo:101: 00002000:00080000:3.0:1788359235.960143:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788359235.960169:0:8433:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5607800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359235.960186:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.960237:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445301120:12345-0@lo:8: Request processed in 712us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359235.960244:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788359235.960299:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a7b80 x1875230445301120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359235.960310:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359235.960319:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788359235.960327:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788359235.960333:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788359235.960336:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c559a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788359235.960351:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788359235.960355:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445301120:0@lo:8: 00000100:00100000:3.0:1788359235.960427:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445299840:12345-0@lo:700: Request processed in 113222us (113481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359235.960440:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788359235.960453:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2753480 x1875230445299840/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.960478:0:8874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445299840:0@lo:700: 00000100:00100000:1.0:1788359235.960897:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccd08780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.960915:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301376 00000100:00100000:1.0:1788359235.960920:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301376 00000100:00100000:1.0:1788359235.960952:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788359235.960962:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445301376:12345-0@lo:101: 00010000:00010000:1.0:1788359235.960972:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359235.960991:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae2fc expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.961015:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.961025:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359235.961034:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057a00, rc 0) 00000100:00100000:1.0:1788359235.961080:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445301376:12345-0@lo:101: Request processed in 119us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359235.961086:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000004:00080000:1.0:1788359235.961117:0:8879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788359235.961369:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445301376:0@lo:101: 00010000:00010000:2.0:1788359235.961386:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.961405:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788359235.961669:0:8879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 267932172525ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788359235.961677:0:8879:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788359235.961770:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445301504:0@lo:501: 00000100:00100000:2.0:1788359235.961806:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.961875:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788359235.961912:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301504 00000100:00100000:1.0:1788359235.961917:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301504 00000100:00100000:1.0:1788359235.961983:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788359235.961991:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445301504:12345-0@lo:501: 00000100:00100000:1.0:1788359235.962058:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445301504:12345-0@lo:501: Request processed in 68us (252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788359235.962065:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788359235.962116:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445301504:0@lo:501: 10000000:01000000:2.0:1788359235.962158:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788359235.962165:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359235.962180:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788359235.964441:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788359235.975184:0:8874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788359235.975219:0:8874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445301760:0@lo:7: 00000100:00100000:2.0:1788359235.975286:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.975331:0:8874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.975354:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445301632:0@lo:13: 00000100:00100000:0.0:1788359235.975356:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301760 00000100:00100000:0.0:1788359235.975366:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301760 00000100:00100000:2.0:1788359235.975398:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.975430:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788359235.975442:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445301760:12345-0@lo:7: 00000100:00100000:2.0:1788359235.975447:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301632 00000100:00100000:2.0:1788359235.975453:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301632 00000100:00100000:2.0:1788359235.975481:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359235.975524:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445301632:12345-0@lo:13: 00002000:00000024:2.0:1788359235.975547:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788359235.975608:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445301632:12345-0@lo:13: Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.975616:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788359235.975815:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0f480 x1875230445301632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359235.975840:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445301632:0@lo:13: 00010000:00010000:3.0:1788359235.982329:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359235.989046:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445301888:0@lo:13: 00000004:00080000:2.0:1788359235.989214:0:8880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788359235.989240:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302016:0@lo:7: 00000100:00100000:2.0:1788359235.989297:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.989335:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.991475:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788359235.991491:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788359235.992540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359235.992706:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445301888 00000100:00100000:3.0:1788359235.992716:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445301888 00000100:00100000:3.0:1788359235.992780:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359235.992790:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445301888:12345-0@lo:13: 00002000:00080000:0.0:1788359235.992814:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00000024:3.0:1788359235.992815:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00002000:00080000:0.0:1788359235.992821:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788359235.992875:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445301888:12345-0@lo:13: Request processed in 86us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359235.992883:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445301760:12345-0@lo:7: Request processed in 17442us (17594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359235.992886:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359235.992897:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788359235.992924:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788359235.992947:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0df80 x1875230445301760/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788359235.992960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0f480 x1875230445301888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359235.992964:0:8874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445301760:0@lo:7: 00000004:00080000:0.0:1788359235.992979:0:8874:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788359235.992997:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445301888:0@lo:13: 00000100:00100000:0.0:1788359235.993022:0:8874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445302144:0@lo:5: 00000100:00100000:0.0:1788359235.993055:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359235.993083:0:8874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccc60c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359235.993096:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302016 00000100:00100000:0.0:1788359235.993100:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302016 00000100:00100000:0.0:1788359235.993117:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302144 00000100:00100000:0.0:1788359235.993120:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302144 00000100:00100000:0.0:1788359235.993134:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359235.993138:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8880:x1875230445302016:12345-0@lo:7: 00000100:00100000:2.0:1788359235.996934:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359235.996955:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445302144:12345-0@lo:5: 00002000:00080000:2.0:1788359235.997000:0:8882:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788359235.997243:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445302144:12345-0@lo:5: Request processed in 295us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359235.997251:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788359235.997411:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61be680 x1875230445302144/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359235.997429:0:8874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445302144:0@lo:5: 00000004:00080000:0.0:1788359235.997443:0:8874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788359235.997516:0:8874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445302272:0@lo:5: 00000100:00100000:0.0:1788359235.997554:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359235.997595:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302272 00000100:00100000:0.0:1788359235.997595:0:8874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccc60c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359235.997603:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302272 00000100:00100000:2.0:1788359235.997645:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359235.997654:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8874:x1875230445302272:12345-0@lo:5: 00002000:00080000:2.0:1788359235.997690:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788359236.007618:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8874:x1875230445302272:12345-0@lo:5: Request processed in 9960us (10056us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788359236.007632:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788359236.008027:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61be680 x1875230445302272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359236.008049:0:8874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8874:1875230445302272:0@lo:5: 00000004:00080000:1.0:1788359236.008067:0:8874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788359236.008115:0:8874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8874:1875230445302400:0@lo:900: 00000100:00100000:1.0:1788359236.008170:0:8874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359236.008203:0:8874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccd080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359236.010797:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302400 00000100:00100000:2.0:1788359236.010813:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302400 00000100:00100000:2.0:1788359236.010895:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788359236.010906:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8874:x1875230445302400:12345-0@lo:900: 00000100:00100000:2.0:1788359236.011009:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8874:x1875230445302400:12345-0@lo:900: Request processed in 104us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359236.011017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788359236.012673:0:8874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a6680 x1875230445302400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788359252 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359236.012699:0:8874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8874:1875230445302400:0@lo:900: 00002000:00080000:0.0:1788359236.012917:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788359236.012924:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788359236.012997:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8880:x1875230445302016:12345-0@lo:7: Request processed in 19856us (23698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359236.013006:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788359236.014116:0:8880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0ea00 x1875230445302016/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359251 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359236.014133:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302016:0@lo:7: 00000004:00080000:2.0:1788359236.014146:0:8880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788359236.014187:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302528:0@lo:5: 00000100:00100000:2.0:1788359236.014233:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359236.014266:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359236.014651:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302528 00000100:00100000:3.0:1788359236.014659:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302528 00000100:00100000:3.0:1788359236.015253:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359236.015264:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8880:x1875230445302528:12345-0@lo:5: 00002000:00080000:3.0:1788359236.015300:0:8882:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788359236.015305:0:8882:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788359236.032364:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788359236.033113:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788359236.033122:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788359236.033367:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8880:x1875230445302528:12345-0@lo:5: Request processed in 18100us (19128us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788359236.033379:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788359236.036211:0:8880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0ea00 x1875230445302528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359252 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359236.036227:0:8880:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788359236.036235:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302528:0@lo:5: 00000004:00080000:3.0:1788359236.036251:0:8880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788359236.036307:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302656:0@lo:700: 00000100:00100000:3.0:1788359236.036364:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359236.037150:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302656 00000100:00100000:3.0:1788359236.037158:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302656 00000100:00100000:3.0:1788359236.037210:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359236.037220:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8880:x1875230445302656:12345-0@lo:700: 00000100:00100000:3.0:1788359236.037798:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788359236.062953:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8880:x1875230445302656:12345-0@lo:700: Request processed in 25726us (26580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359236.062977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788359236.063412:0:8880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead27b9c00 x1875230445302656/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788359252 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359236.063449:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302656:0@lo:700: 00000004:02000040:3.0:1788359236.067804:0:8880:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788359236.078688:0:8880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302784:0@lo:5: 00000100:00100000:1.0:1788359236.078779:0:8880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359236.078847:0:8880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccd080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359236.078913:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302784 00000100:00100000:2.0:1788359236.078923:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302784 00000100:00100000:2.0:1788359236.079051:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788359236.079063:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8880:x1875230445302784:12345-0@lo:5: 00002000:00080000:3.0:1788359236.094015:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788359236.094037:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788359236.098356:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8880:x1875230445302784:12345-0@lo:5: Request processed in 19288us (19570us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788359236.098385:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788359236.107164:0:8880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead27b9c00 x1875230445302784/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359252 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359236.107188:0:8880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8880:1875230445302784:0@lo:5: 00000004:00080000:2.0:1788359236.107205:0:8880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000001:00080000:0.0:1788359236.558930:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788359236.991053:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359238.012963:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788359238.520015:0:8962:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359238.520272:0:8962:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788359238.845103:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445302912:0@lo:41: 00000100:00100000:3.0:1788359238.845184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359238.845330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445302912 00000100:00100000:2.0:1788359238.845338:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445302912 00000100:00100000:2.0:1788359238.845388:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359238.845397:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445302912:12345-0@lo:41: 00000004:00000024:2.0:1788359238.845444:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788359238.846126:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445302912:12345-0@lo:41: Request processed in 728us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359238.846135:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788359238.846205:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445302912:0@lo:41: 00010000:00010000:2.0:1788359239.037987:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359239.359039:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445303040:0@lo:41: 00000100:00100000:1.0:1788359239.359119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359239.359197:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303040 00000100:00100000:1.0:1788359239.359204:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303040 00000100:00100000:1.0:1788359239.359249:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788359239.359258:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445303040:12345-0@lo:41: 00000004:00000024:1.0:1788359239.359292:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788359239.359336:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445303040:12345-0@lo:41: Request processed in 79us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359239.359343:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788359239.359385:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445303040:0@lo:41: 00000020:00000004:2.0:1788359239.465424:0:9010:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359239.465434:0:9010:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788359240.067321:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359241.086137:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359241.404860:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445303296:0@lo:400: 00000100:00100000:0.0:1788359241.404946:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359241.405000:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445303808:0@lo:400: 00000100:00100000:0.0:1788359241.405023:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359241.405175:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788359241.405183:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445303424:0@lo:400: 00000100:00100000:0.0:1788359241.405210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359241.405230:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445303936:0@lo:400: 00000100:00100000:0.0:1788359241.405251:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359241.405300:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303296 00000100:00100000:0.0:1788359241.405307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303296 00000100:00100000:0.0:1788359241.405358:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303808 00000100:00100000:0.0:1788359241.405362:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303808 00000100:00100000:0.0:1788359241.405389:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303936 00000100:00100000:0.0:1788359241.405392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303936 00000100:00100000:0.0:1788359241.405407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359241.405416:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445303296:12345-0@lo:400: 00000100:00100000:0.0:1788359241.405471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445303296:12345-0@lo:400: Request processed in 57us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.405478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359241.405492:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359241.405521:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445303808:12345-0@lo:400: 00000100:00100000:0.0:1788359241.405578:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445303808:12345-0@lo:400: Request processed in 58us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.405584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359241.405594:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359241.405599:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445303936:12345-0@lo:400: 00000100:00100000:0.0:1788359241.405623:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445303936:12345-0@lo:400: Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.405628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359241.405649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303424 00000100:00100000:0.0:1788359241.405653:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303424 00000100:00100000:0.0:1788359241.405678:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359241.405684:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445303424:12345-0@lo:400: 00000100:00100000:0.0:1788359241.405714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445303424:12345-0@lo:400: Request processed in 31us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.405720:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788359241.405749:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359241.405753:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359241.405786:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445303424:0@lo:400: 00010000:00080000:0.0:1788359241.405801:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bc380 x1875230445303936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.405811:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445303936:0@lo:400: 00010000:00080000:0.0:1788359241.405820:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bf480 x1875230445303296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.405828:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445303296:0@lo:400: 00010000:00080000:0.0:1788359241.405836:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bd880 x1875230445303808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.405844:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445303808:0@lo:400: 00000100:00100000:1.0:1788359241.406113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445303168:0@lo:400: 00000100:00100000:1.0:1788359241.406151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.406177:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445303680:0@lo:400: 00000100:00100000:1.0:1788359241.406199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.406216:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445304192:0@lo:400: 00000100:00100000:1.0:1788359241.406248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.406269:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788359241.406274:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445303552:0@lo:400: 00000100:00100000:1.0:1788359241.406297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.406311:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445304064:0@lo:400: 00000100:00100000:1.0:1788359241.406332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.406356:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303680 00000100:00100000:1.0:1788359241.406360:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303680 00000100:00100000:1.0:1788359241.406385:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788359241.406391:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445303680:12345-0@lo:400: 00000100:00100000:1.0:1788359241.406428:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445303680:12345-0@lo:400: Request processed in 37us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359241.406434:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788359241.406461:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445303680:0@lo:400: 00000100:00100000:0.0:1788359241.410642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303168 00000100:00100000:0.0:1788359241.410660:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303168 00000100:00100000:0.0:1788359241.410734:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788359241.410744:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3645:x1875230445303168:12345-0@lo:400: 00000100:00100000:0.0:1788359241.410839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3645:x1875230445303168:12345-0@lo:400: Request processed in 97us (4686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.410847:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788359241.410887:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304192 00000100:00100000:0.0:1788359241.410891:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304192 00000100:00100000:0.0:1788359241.410927:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304064 00000100:00100000:0.0:1788359241.410931:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304064 00000100:00100000:0.0:1788359241.410953:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359241.410959:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445304192:12345-0@lo:400: 00000100:00100000:0.0:1788359241.410995:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445304192:12345-0@lo:400: Request processed in 37us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.411016:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359241.411027:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359241.411033:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445304064:12345-0@lo:400: 00000100:00100000:0.0:1788359241.411064:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445304064:12345-0@lo:400: Request processed in 31us (4731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.411069:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788359241.411112:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c6375880 x1875230445304064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.411123:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788359241.411141:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445304064:0@lo:400: 00000100:00100000:0.0:1788359241.411152:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445303168:0@lo:400: 00010000:00080000:0.0:1788359241.411162:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c6377480 x1875230445304192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.411169:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788359241.411177:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445304192:0@lo:400: 00000100:00100000:0.0:1788359241.411204:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359241.411219:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445304320:0@lo:13: 00000100:00100000:0.0:1788359241.411253:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359241.411326:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359241.411343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445303552 00000100:00100000:0.0:1788359241.411347:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445303552 00000100:00100000:0.0:1788359241.411373:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788359241.411379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445303552:12345-0@lo:400: 00000100:00100000:0.0:1788359241.411413:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445303552:12345-0@lo:400: Request processed in 35us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359241.411426:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788359241.411453:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c61bca80 x1875230445303552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.411463:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445303552:0@lo:400: 00000100:00100000:0.0:1788359241.412238:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445304448:0@lo:13: 00000100:00100000:0.0:1788359241.412272:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359241.412388:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304320 00000100:00100000:1.0:1788359241.412394:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304320 00000100:00100000:1.0:1788359241.412415:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304448 00000100:00100000:1.0:1788359241.412417:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304448 00000100:00100000:1.0:1788359241.412428:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359241.412434:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445304320:12345-0@lo:13: 00002000:00000024:1.0:1788359241.412457:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359241.412598:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445304320:12345-0@lo:13: Request processed in 163us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359241.412605:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359241.412621:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359241.412628:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445304448:12345-0@lo:13: 00002000:00000024:1.0:1788359241.412637:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359241.412672:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445304448:12345-0@lo:13: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359241.412679:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788359241.413919:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a7b80 x1875230445304448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.413942:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445304448:0@lo:13: 00010000:00080000:0.0:1788359241.413955:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead27bbb80 x1875230445304320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359257 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359241.413966:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445304320:0@lo:13: 00010000:00010000:0.0:1788359242.111991:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359243.132810:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359243.971834:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445304576:0@lo:41: 00000100:00100000:1.0:1788359243.971951:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359243.972148:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304576 00000100:00100000:0.0:1788359243.972156:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304576 00000100:00100000:0.0:1788359243.972208:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359243.972217:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445304576:12345-0@lo:41: 00000004:00000024:0.0:1788359243.972252:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788359243.972613:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445304576:12345-0@lo:41: Request processed in 387us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359243.972621:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788359243.972724:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445304576:0@lo:41: 00010000:00010000:1.0:1788359244.157654:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359244.480482:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445304704:0@lo:41: 00000100:00100000:1.0:1788359244.480601:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359244.480800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304704 00000100:00100000:2.0:1788359244.480811:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304704 00000100:00100000:2.0:1788359244.480871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788359244.480880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445304704:12345-0@lo:41: 00000004:00000024:2.0:1788359244.480915:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788359244.480963:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445304704:12345-0@lo:41: Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359244.480970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788359244.481179:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445304704:0@lo:41: 00010000:00010000:2.0:1788359245.192120:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359246.205806:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359246.525112:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445304960:0@lo:400: 00000100:00100000:2.0:1788359246.525184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525228:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445305472:0@lo:400: 00000100:00100000:2.0:1788359246.525248:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525279:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359246.525285:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445304832:0@lo:400: 00000100:00100000:2.0:1788359246.525312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525333:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445305344:0@lo:400: 00000100:00100000:2.0:1788359246.525403:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525432:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445305856:0@lo:400: 00000100:00100000:2.0:1788359246.525457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525524:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445305088:0@lo:400: 00000100:00100000:2.0:1788359246.525548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525565:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445305600:0@lo:400: 00000100:00100000:2.0:1788359246.525587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525608:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788359246.525615:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445305216:0@lo:400: 00000100:00100000:2.0:1788359246.525638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525657:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445305728:0@lo:400: 00000100:00100000:2.0:1788359246.525678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359246.525709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304960 00000100:00100000:2.0:1788359246.525717:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304960 00000100:00100000:2.0:1788359246.525756:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305472 00000100:00100000:2.0:1788359246.525760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305472 00000100:00100000:2.0:1788359246.525786:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305600 00000100:00100000:2.0:1788359246.525789:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305600 00000100:00100000:2.0:1788359246.525802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305216 00000100:00100000:2.0:1788359246.525804:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305216 00000100:00100000:2.0:1788359246.525817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359246.525825:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445304960:12345-0@lo:400: 00000100:00100000:2.0:1788359246.525879:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445304960:12345-0@lo:400: Request processed in 54us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.525886:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359246.525901:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359246.525907:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445305472:12345-0@lo:400: 00000100:00100000:2.0:1788359246.525934:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445305472:12345-0@lo:400: Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.525947:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359246.525959:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359246.525965:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445305600:12345-0@lo:400: 00000100:00100000:2.0:1788359246.526000:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445305600:12345-0@lo:400: Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.526006:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359246.526017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359246.526023:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445305216:12345-0@lo:400: 00000100:00100000:2.0:1788359246.526049:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445305216:12345-0@lo:400: Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.526055:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359246.527417:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305344 00000100:00100000:2.0:1788359246.527430:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305344 00000100:00100000:2.0:1788359246.527520:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305088 00000100:00100000:2.0:1788359246.527524:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305088 00000100:00100000:2.0:1788359246.527546:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788359246.527554:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445305344:12345-0@lo:400: 00000100:00100000:2.0:1788359246.527629:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445305344:12345-0@lo:400: Request processed in 76us (2226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.527636:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788359246.527651:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788359246.527656:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445305088:12345-0@lo:400: 00000100:00100000:2.0:1788359246.527682:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445305088:12345-0@lo:400: Request processed in 26us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.527688:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788359246.527714:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305856 00000100:00100000:2.0:1788359246.527733:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305856 00000100:00100000:2.0:1788359246.527768:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305728 00000100:00100000:2.0:1788359246.527771:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305728 00000100:00100000:2.0:1788359246.527802:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359246.527809:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445305856:12345-0@lo:400: 00000100:00100000:2.0:1788359246.527839:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445305856:12345-0@lo:400: Request processed in 32us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.527845:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359246.527855:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788359246.527861:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445305728:12345-0@lo:400: 00000100:00100000:2.0:1788359246.527888:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445305728:12345-0@lo:400: Request processed in 28us (2210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359246.527894:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788359246.527926:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359246.527931:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359246.527933:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788359246.527979:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eafeff5500 x1875230445305216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.527996:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445305216:0@lo:400: 00010000:00080000:2.0:1788359246.528009:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eafeff5f80 x1875230445305728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.528016:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445305728:0@lo:400: 00000100:00100000:2.0:1788359246.528026:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445305088:0@lo:400: 00010000:00080000:2.0:1788359246.528038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eafeff5180 x1875230445305600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.528045:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445305600:0@lo:400: 00000100:00100000:2.0:1788359246.528096:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445305344:0@lo:400: 00010000:00080000:2.0:1788359246.528108:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eafeff6a00 x1875230445305856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.528116:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445305856:0@lo:400: 00010000:00080000:2.0:1788359246.528127:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0df80 x1875230445304960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.528135:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445304960:0@lo:400: 00010000:00080000:2.0:1788359246.528146:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eafeff4380 x1875230445305472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.528155:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445305472:0@lo:400: 00000100:00100000:0.0:1788359246.528514:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359246.528548:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445305984:0@lo:13: 00000100:00100000:0.0:1788359246.528597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359246.528677:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445305984 00000100:00100000:3.0:1788359246.528682:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445305984 00000100:00100000:3.0:1788359246.528717:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788359246.528724:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445305984:12345-0@lo:13: 00002000:00000024:3.0:1788359246.528746:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359246.528800:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445305984:12345-0@lo:13: Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359246.528806:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788359246.528833:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead27b9500 x1875230445305984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359246.528846:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445305984:0@lo:13: 00000100:00100000:1.0:1788359246.528966:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788359246.529049:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445306112:0@lo:13: 00000100:00100000:1.0:1788359246.529079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359246.529165:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445304832 00000100:00100000:1.0:1788359246.529169:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445304832 00000100:00100000:1.0:1788359246.529204:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788359246.529210:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3643:x1875230445304832:12345-0@lo:400: 00000100:00100000:1.0:1788359246.529239:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3643:x1875230445304832:12345-0@lo:400: Request processed in 30us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359246.529245:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788359246.530615:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445304832:0@lo:400: 00000100:00100000:0.0:1788359246.531105:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306112 00000100:00100000:0.0:1788359246.531114:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306112 00000100:00100000:0.0:1788359246.531202:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359246.531212:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445306112:12345-0@lo:13: 00002000:00000024:0.0:1788359246.531235:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359246.531306:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445306112:12345-0@lo:13: Request processed in 96us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359246.531313:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788359246.531375:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c55a5500 x1875230445306112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359262 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359246.531393:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445306112:0@lo:13: 00010000:00010000:0.0:1788359247.228743:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359248.257121:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788359248.868431:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788359248.868436:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788359248.868437:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788359248.868868:0:9509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0eaff1c4000 00000020:01000004:0.0:1788359248.868889:0:9509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788359248.868907:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788359248.868928:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0eaffa44d40) 00000020:00000080:0.0:1788359248.868950:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788359248.918401:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788359248.918484:0:9509:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788359248.967892:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788359248.968330:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788359248.968344:0:9509:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788359248.968357:0:9509:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49dd053b5feae311 00000020:01000004:3.0:1788359248.968365:0:9509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788359248.968400:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788359248.968404:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788359248.968410:0:9509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788359248.968444:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788359248.968450:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788359249.011359:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788359249.011399:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.152@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788359249.011404:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788359249.011405:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788359249.011407:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359249.011413:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359249.011414:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359249.011416:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359249.011417:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788359249.011418:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788359249.011420:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788359249.011422:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359249.011423:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359249.011426:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788359249.011429:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788359249.011430:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788359249.011431:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359249.011432:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359249.011432:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359249.011433:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359249.011434:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788359249.011435:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788359249.011435:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788359249.011436:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359249.011437:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359249.011475:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788359249.011628:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445306240:0@lo:253: 00000100:00100000:1.0:1788359249.011700:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.011796:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359249.011844:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306240 00000100:00100000:3.0:1788359249.011853:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306240 00000100:00100000:3.0:1788359249.012028:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359249.012038:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:9509:x1875230445306240:12345-0@lo:253: 20000000:01000000:3.0:1788359249.012138:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788359249.012142:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788359249.012147:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788359249.012151:0:6509:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788359249.012480:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359249.013448:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788359249.013479:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788359249.013710:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788359249.013721:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788359249.013738:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788359249.013753:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788359249.013855:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788359249.013872:0:6509:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:2.0:1788359249.013881:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788359249.013899:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788359249.013905:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788359249.013919:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788359249.013925:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:2.0:1788359249.013936:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788359249.013942:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788359249.013967:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788359249.013986:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788359249.014130:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788359249.014142:0:6509:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:2.0:1788359249.014144:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788359249.014157:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788359249.014161:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788359249.014172:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788359249.014176:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:2.0:1788359249.014187:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788359249.014192:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788359249.014270:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788359249.014290:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788359249.014675:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788359249.014687:0:6509:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.152@tcp 20000000:01000000:2.0:1788359249.014689:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788359249.014704:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788359249.014710:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788359249.014725:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788359249.014730:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.152@tcp (null) (null) 00000040:00080000:2.0:1788359249.014743:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788359249.014749:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788359249.014762:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788359249.014792:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788359249.014805:0:6509:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788359249.014808:0:6509:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788359249.014812:0:6509:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788359249.014855:0:6509:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788359249.014857:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788359249.015474:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788359249.015589:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788359249.015604:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788359249.015791:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788359249.015812:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788359249.015826:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788359249.015837:0:6509:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788359249.015839:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788359249.016363:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788359249.016384:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788359249.016399:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788359249.016653:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788359249.016673:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788359249.016688:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788359249.016697:0:6509:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788359249.016699:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788359249.017174:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1788359249.017404:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1788359249.017425:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1788359249.017439:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1788359249.017448:0:6509:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788359249.017450:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788359249.017913:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788359249.017937:0:9518:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788359249.017952:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788359249.018312:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788359249.018334:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788359249.018351:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788359249.018361:0:6509:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788359249.018363:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788359249.018805:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788359249.018827:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788359249.018843:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788359249.019151:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788359249.019172:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788359249.019189:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1788359249.019280:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788359249.019302:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019319:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae207 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019341:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae231 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019348:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae270 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019355:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae28c expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019361:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019368:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019374:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019382:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019424:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019439:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.019466:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306368:0@lo:104: 00000100:00100000:2.0:1788359249.019748:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359249.019844:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019853:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.019862:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306496:0@lo:104: 00000100:00100000:2.0:1788359249.019885:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359249.019974:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.019983:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.019991:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306624:0@lo:104: 00000100:00100000:2.0:1788359249.020011:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.020166:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306368 00000100:00100000:3.0:1788359249.020175:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306368 00000100:00100000:3.0:1788359249.020300:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306496 00000100:00100000:3.0:1788359249.020304:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306496 00000100:00100000:3.0:1788359249.020323:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359249.020331:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445306368:12345-0@lo:104: 00010000:00010000:3.0:1788359249.020356:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020420:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359249.020427:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445306368:12345-0@lo:104: Request processed in 96us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.020434:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359249.020467:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359249.020475:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445306496:12345-0@lo:104: 00010000:00010000:3.0:1788359249.020482:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020552:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788359249.020558:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445306496:12345-0@lo:104: Request processed in 85us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.020564:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788359249.020582:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359249.020589:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020596:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.020601:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020609:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.020616:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.020629:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359249.020666:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020673:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359249.020692:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020699:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056800/0x49dd053b5feae2fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae303 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020714:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359249.020717:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020722:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.020726:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020732:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.020739:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.020744:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359249.020758:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020763:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359249.020784:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020791:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0031800/0x49dd053b5feae2d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2d9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.020802:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359249.020804:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359249.020806:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359249.020822:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359249.020834:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445306752:0@lo:103: 00000100:00100000:3.0:1788359249.020865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.020906:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445306880:0@lo:103: 00000100:00100000:3.0:1788359249.020928:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359249.021341:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.021353:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.021362:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307008:0@lo:104: 00000100:00100000:2.0:1788359249.021385:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.021450:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306752 00000100:00100000:3.0:1788359249.021465:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306752 00010000:00010000:3.0:1788359249.021488:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 22 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359249.021528:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306880 00000100:00100000:3.0:1788359249.021530:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306880 00010000:00010000:3.0:1788359249.021540:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359249.021557:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359249.021564:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3645:x1875230445306752:12345-0@lo:103: 00010000:00010000:3.0:1788359249.021574:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359249.021580:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 23 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.021607:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 23 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.021623:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359249.021658:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3645:x1875230445306752:12345-0@lo:103: Request processed in 94us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.021665:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359249.021680:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359249.021686:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:3642:x1875230445306880:12345-0@lo:103: 00010000:00010000:3.0:1788359249.021693:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359249.021698:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 22 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.021706:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 22 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.021715:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359249.021741:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:3642:x1875230445306880:12345-0@lo:103: Request processed in 56us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.021747:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359249.021790:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445306880:0@lo:103: 00000100:00100000:3.0:1788359249.021815:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445306752:0@lo:103: 00010000:00010000:2.0:1788359249.021967:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.021976:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 21 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.021985:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307136:0@lo:104: 00000100:00100000:2.0:1788359249.022011:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.022166:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445306624 00000100:00100000:0.0:1788359249.022171:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445306624 00000100:00100000:0.0:1788359249.022192:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307008 00000100:00100000:0.0:1788359249.022194:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307008 00000100:00100000:0.0:1788359249.022215:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788359249.022222:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445306624:12345-0@lo:104: 00010000:00010000:0.0:1788359249.022231:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.022269:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359249.022279:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445306624:12345-0@lo:104: Request processed in 58us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.022285:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788359249.022298:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359249.022303:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445307008:12345-0@lo:104: 00010000:00010000:0.0:1788359249.022310:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.022341:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788359249.022346:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445307008:12345-0@lo:104: Request processed in 44us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.022352:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788359249.022713:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.022723:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 21 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.022732:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307264:0@lo:104: 00000100:00100000:2.0:1788359249.022758:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359249.022778:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.022786:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 21 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.022794:0:6509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307392:0@lo:104: 00000100:00100000:2.0:1788359249.022810:0:6509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6881480 going to sleep for 11 seconds 00010000:00010000:2.0:1788359249.022826:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057a00/0x49dd053b5feae303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae2fc expref: 21 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.022836:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306368:0@lo:104: 00010000:00010000:2.0:1788359249.022846:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae2d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae2d2 expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.022853:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306496:0@lo:104: 00000100:00100000:2.0:1788359249.022861:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445306624:0@lo:104: 00000100:00100000:2.0:1788359249.022868:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307008:0@lo:104: 00000100:00100000:0.0:1788359249.022922:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788359249.022941:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.022950:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307136 00000100:00100000:0.0:1788359249.022953:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307136 00000100:00100000:0.0:1788359249.022984:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307264 00000100:00100000:0.0:1788359249.022987:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307264 00000100:00100000:0.0:1788359249.022996:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307392 00000100:00100000:0.0:1788359249.022999:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307392 00000100:00100000:0.0:1788359249.023009:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359249.023015:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:6509:x1875230445307136:12345-0@lo:104: 00010000:00010000:0.0:1788359249.023024:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.023190:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788359249.023196:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:6509:x1875230445307136:12345-0@lo:104: Request processed in 181us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.023212:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359249.023237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359249.023243:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffa33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445307264:12345-0@lo:104: 00010000:00010000:0.0:1788359249.023252:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.023279:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788359249.023284:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffa33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6509:x1875230445307264:12345-0@lo:104: Request processed in 42us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.023290:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359249.023322:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359249.023328:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445307392:12345-0@lo:104: 00010000:00010000:0.0:1788359249.023335:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.023361:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788359249.023366:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6509:x1875230445307392:12345-0@lo:104: Request processed in 39us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.023371:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788359249.023585:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307136:0@lo:104: 00000100:00100000:2.0:1788359249.023605:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307264:0@lo:104: 00000100:00100000:2.0:1788359249.023612:0:6509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6509:1875230445307392:0@lo:104: 00010000:00010000:2.0:1788359249.023642:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.023800:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788359249.023807:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.023815:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.023836:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.023845:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.023852:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.023857:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359249.023924:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.023932:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788359249.024035:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445307520:0@lo:103: 00000100:00100000:0.0:1788359249.024081:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.024226:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307520 00000100:00100000:1.0:1788359249.024231:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307520 00010000:00010000:1.0:1788359249.024255:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.024285:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788359249.024292:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3643:x1875230445307520:12345-0@lo:103: 00010000:00010000:1.0:1788359249.024303:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359249.024307:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.024317:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.024341:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056400/0x49dd053b5feae2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae2b6 expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.024353:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359249.024383:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3643:x1875230445307520:12345-0@lo:103: Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.024389:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788359249.024542:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445307520:0@lo:103: 00010000:00010000:3.0:1788359249.024649:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.024658:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae2b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.024668:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788359249.024671:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.024677:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.024680:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.024687:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.024704:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.024709:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359249.025437:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025447:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359249.025485:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025545:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae28c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae293 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025558:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788359249.025561:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025568:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.025571:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025579:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.025585:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.025591:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788359249.025662:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445307648:0@lo:103: 00000100:00100000:0.0:1788359249.025713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359249.025902:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.025909:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788359249.025945:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445307776:0@lo:103: 00000100:00100000:1.0:1788359249.025986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.026158:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307648 00000100:00100000:0.0:1788359249.026166:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307648 00010000:00010000:0.0:1788359249.026190:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 19 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.026243:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307776 00000100:00100000:0.0:1788359249.026246:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307776 00010000:00010000:0.0:1788359249.026259:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 20 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.026278:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359249.026286:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3644:x1875230445307648:12345-0@lo:103: 00010000:00010000:0.0:1788359249.026296:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359249.026301:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026312:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026326:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40600/0x49dd053b5feae293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae28c expref: 20 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026340:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359249.026372:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3644:x1875230445307648:12345-0@lo:103: Request processed in 87us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.026380:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359249.026421:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359249.026428:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3645:x1875230445307776:12345-0@lo:103: 00010000:00010000:0.0:1788359249.026435:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359249.026440:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 18 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026448:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 18 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026486:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae270 expref: 18 pid: 6509 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.026516:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359249.026631:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026640:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae277 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026651:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359249.026655:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026661:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.026664:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026671:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.026676:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.026681:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788359249.026841:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026848:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359249.026863:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026881:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae238 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026892:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359249.026895:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026900:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359249.026903:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.026909:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359249.026915:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359249.026919:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788359249.027051:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:3645:x1875230445307776:12345-0@lo:103: Request processed in 612us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.027060:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359249.027098:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445307648:0@lo:103: 00000100:00100000:0.0:1788359249.027117:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359249.027124:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445307904:0@lo:103: 00000100:00100000:0.0:1788359249.027152:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359249.027327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445307904 00000100:00100000:2.0:1788359249.027333:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445307904 00010000:00010000:2.0:1788359249.027352:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359249.027372:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788359249.027378:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:3643:x1875230445307904:12345-0@lo:103: 00010000:00010000:2.0:1788359249.027387:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359249.027391:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.027400:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.027413:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae231 expref: 17 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.027423:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359249.027465:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3643:x1875230445307904:12345-0@lo:103: Request processed in 78us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.027471:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359249.027548:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445307904:0@lo:103: 00010000:00010000:2.0:1788359249.027619:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359249.027670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445307776:0@lo:103: 00010000:00010000:3.0:1788359249.027774:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.027781:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359249.027798:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.027805:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae20e expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.027818:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359249.027827:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359249.027829:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359249.027835:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359249.027844:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445308032:0@lo:103: 00000100:00100000:3.0:1788359249.027871:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.028121:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308032 00000100:00100000:1.0:1788359249.028126:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308032 00010000:00010000:1.0:1788359249.028145:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 16 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.028269:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788359249.028278:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3642:x1875230445308032:12345-0@lo:103: 00010000:00010000:1.0:1788359249.028286:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359249.028291:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 16 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028300:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 16 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028312:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae207 expref: 16 pid: 6508 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028324:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028339:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028354:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028361:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028368:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028374:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028380:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359249.028384:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028391:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028414:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.028423:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359249.028472:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3642:x1875230445308032:12345-0@lo:103: Request processed in 195us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.028479:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359249.028552:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445308032:0@lo:103: 00010000:00010000:2.0:1788359249.028614:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.028632:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.028637:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae318 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788359249.028651:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788359249.031339:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:9509:x1875230445306240:12345-0@lo:253: Request processed in 19291us (19627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.031355:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359249.031562:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445306240:0@lo:253: 10000000:01000000:3.0:1788359249.031578:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788359249.031583:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788359249.031584:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788359249.031586:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359249.031587:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788359249.031589:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359249.031590:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359249.031592:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788359249.031593:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788359249.031595:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359249.031596:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788359249.031623:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0eaff1c4000 from lustre-OST0001 10000000:01000000:3.0:1788359249.031659:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788359249.031663:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788359249.031672:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0eaf5930000 local copy 10000000:01000000:3.0:1788359249.031676:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788359249.031713:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.031725:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.031736:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359249.031755:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308160:0@lo:101: 00000100:00100000:3.0:1788359249.031802:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.031829:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.031891:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308160 00000100:00100000:2.0:1788359249.031898:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308160 00000100:00100000:2.0:1788359249.031945:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788359249.031955:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+14:9509:x1875230445308160:12345-0@lo:101: 00010000:00010000:2.0:1788359249.031967:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359249.031981:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac41000/0x49dd053b5feae326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae31f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.032003:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac41000/0x49dd053b5feae326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae31f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.032014:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac41000/0x49dd053b5feae326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae31f expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.032023:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41000, rc 0) 00000100:00100000:2.0:1788359249.032063:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:9509:x1875230445308160:12345-0@lo:101: Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.032070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788359249.032285:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308160:0@lo:101: 00010000:00010000:3.0:1788359249.032301:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032311:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359249.032403:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308288:0@lo:501: 00000100:00100000:3.0:1788359249.032429:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.032468:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308288 00000100:00100000:3.0:1788359249.032473:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308288 00000100:00100000:3.0:1788359249.032525:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788359249.032533:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:9509:x1875230445308288:12345-0@lo:501: 00000100:00100000:3.0:1788359249.032588:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:9509:x1875230445308288:12345-0@lo:501: Request processed in 55us (158us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788359249.032594:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788359249.032620:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359249.032632:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308288:0@lo:501: 10000000:01000000:3.0:1788359249.032642:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788359249.032658:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788359249.032664:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032672:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032690:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032704:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788359249.032727:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eaff1c4000 10000000:01000000:3.0:1788359249.032732:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788359249.032736:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788359249.032739:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788359249.032743:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788359249.032745:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788359249.032761:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032768:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032777:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359249.032788:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308416:0@lo:101: 00000100:00100000:3.0:1788359249.032812:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.032835:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308416 00000100:00100000:3.0:1788359249.032839:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308416 00000100:00100000:3.0:1788359249.032862:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788359249.032868:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:9509:x1875230445308416:12345-0@lo:101: 00010000:00010000:3.0:1788359249.032875:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359249.032884:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae32d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032906:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae32d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032914:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae32d expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.032921:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea5000, rc 0) 00000100:00100000:3.0:1788359249.032945:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308416:12345-0@lo:101: Request processed in 77us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.032950:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788359249.032976:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359249.032987:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308416:0@lo:101: 00010000:00010000:3.0:1788359249.032998:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359249.033005:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033363:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359249.033370:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033378:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4a00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359249.033381:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033390:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359249.033397:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359249.033402:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788359249.033423:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033429:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359249.033467:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033474:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4a00/0x49dd053b5feae31f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x49dd053b5feae326 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.033489:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359249.033491:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359249.033493:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359249.033557:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308672:0@lo:501: 00000100:00100000:3.0:1788359249.033587:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.033612:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac3ce8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.033692:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445308544:0@lo:103: 00000100:00100000:0.0:1788359249.033723:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359249.034821:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308672 00000100:00100000:2.0:1788359249.034832:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308672 00000100:00100000:2.0:1788359249.034889:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788359249.034898:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308672:12345-0@lo:501: 00000100:00100000:2.0:1788359249.035284:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308672:12345-0@lo:501: Request processed in 386us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.035294:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788359249.035387:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308672:0@lo:501: 00000100:00100000:0.0:1788359249.035435:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308800:0@lo:503: 00000100:00100000:0.0:1788359249.035531:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.035563:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.035621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308800 00000100:00100000:2.0:1788359249.035626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308800 00000100:00100000:2.0:1788359249.035661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788359249.035669:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308800:12345-0@lo:503: 00000100:00100000:2.0:1788359249.035749:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308800:12345-0@lo:503: Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.035757:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788359249.035828:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308800:0@lo:503: 00000040:00080000:0.0:1788359249.036306:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359249.036389:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308928:0@lo:502: 00000100:00100000:0.0:1788359249.036433:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.036465:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.036541:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308928 00000100:00100000:2.0:1788359249.036546:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308928 00000100:00100000:2.0:1788359249.036576:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788359249.036583:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308928:12345-0@lo:502: 00000100:00100000:2.0:1788359249.036666:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445308928:12345-0@lo:502: Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.036673:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788359249.036762:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445308928:0@lo:502: 00000040:00080000:0.0:1788359249.037727:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788359249.037767:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788359249.037783:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788359249.037797:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788359249.037811:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788359249.037826:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788359249.037862:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309056:0@lo:502: 00000100:00100000:0.0:1788359249.037924:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.039362:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309056 00000100:00100000:0.0:1788359249.039379:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309056 00000100:00100000:0.0:1788359249.039452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788359249.039478:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309056:12345-0@lo:502: 00000100:00100000:0.0:1788359249.039662:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309056:12345-0@lo:502: Request processed in 186us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.039670:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788359249.039739:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.039765:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309056:0@lo:502: 00000040:00080000:0.0:1788359249.039846:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788359249.039860:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:1.0:1788359249.040482:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445308544 00000100:00100000:1.0:1788359249.040533:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445308544 00000100:00100000:1.0:1788359249.040736:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359249.040746:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3644:x1875230445308544:12345-0@lo:103: 00010000:00010000:1.0:1788359249.040759:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359249.040779:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41000/0x49dd053b5feae326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae31f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.040797:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359249.040850:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3644:x1875230445308544:12345-0@lo:103: Request processed in 107us (7126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.040857:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359249.040890:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445308544:0@lo:103: 00000020:01000000:2.0:1788359249.042021:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788359249.042033:0:9520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788359249.042107:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359249.042111:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788359249.042118:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359249.042134:0:9520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0eafef78000) 00000020:00000080:2.0:1788359249.042160:0:9520:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788359249.042166:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788359249.042335:0:9520:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaff1c4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788359249.042345:0:9520:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788359249.042352:0:9520:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49dd053b5feae342 00010000:00010000:2.0:1788359249.048720:0:9520:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788359249.049155:0:9520:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788359249.052665:0:9520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788359249.053032:0:9520:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788359249.058973:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788359249.059367:0:9520:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788359249.068307:0:9520:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788359249.073742:0:9520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788359249.073759:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359249.073767:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359249.073769:0:9520:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788359249.073773:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359249.073785:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359249.073787:0:9520:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788359249.073791:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788359249.073793:0:9520:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788359249.073822:0:9520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359249.073825:0:9520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359249.073827:0:9520:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788359249.073831:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788359249.075215:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788359249.075259:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788359249.075281:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075295:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359249.075304:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaff1c4000 from 1 10000000:01000000:0.0:1788359249.075325:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359249.075367:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075384:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075395:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.075421:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309184:0@lo:101: 00000100:00100000:0.0:1788359249.075525:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.075567:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.075601:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309184 00000100:00100000:0.0:1788359249.075608:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309184 00000100:00100000:0.0:1788359249.075657:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788359249.075667:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:9509:x1875230445309184:12345-0@lo:101: 00010000:00010000:0.0:1788359249.075684:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359249.075697:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae349 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075721:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae349 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075731:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae349 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075740:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b600, rc 0) 00000100:00100000:0.0:1788359249.075778:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309184:12345-0@lo:101: Request processed in 113us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.075796:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788359249.075851:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309184:0@lo:101: 00010000:00010000:0.0:1788359249.075864:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.075873:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.075953:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309312:0@lo:501: 00000100:00100000:0.0:1788359249.075979:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.075994:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.076010:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309312 00000100:00100000:0.0:1788359249.076013:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309312 00000100:00100000:0.0:1788359249.076034:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788359249.076039:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309312:12345-0@lo:501: 00000100:00100000:0.0:1788359249.076139:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309312:12345-0@lo:501: Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.076145:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788359249.076172:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309312:0@lo:501: 00000100:00100000:0.0:1788359249.076193:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309440:0@lo:503: 00000100:00100000:0.0:1788359249.076229:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.076240:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.076251:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309440 00000100:00100000:0.0:1788359249.076254:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309440 00000100:00100000:0.0:1788359249.076272:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788359249.076277:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309440:12345-0@lo:503: 00000100:00100000:0.0:1788359249.076352:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309440:12345-0@lo:503: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.076358:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788359249.076402:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309440:0@lo:503: 00000040:00080000:0.0:1788359249.076684:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359249.076733:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309568:0@lo:502: 00000100:00100000:0.0:1788359249.076760:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.076787:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359249.076805:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309568 00000100:00100000:1.0:1788359249.076809:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309568 00000100:00100000:1.0:1788359249.076859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788359249.076866:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309568:12345-0@lo:502: 00000100:00100000:1.0:1788359249.076950:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309568:12345-0@lo:502: Request processed in 83us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.077032:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788359249.077277:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309568:0@lo:502: 00000040:00080000:0.0:1788359249.077469:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788359249.077543:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788359249.077567:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309696:0@lo:502: 00000100:00100000:0.0:1788359249.077604:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.077628:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.077643:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309696 00000100:00100000:0.0:1788359249.077647:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309696 00000100:00100000:0.0:1788359249.077678:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788359249.077684:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309696:12345-0@lo:502: 00000100:00100000:0.0:1788359249.077762:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309696:12345-0@lo:502: Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.077769:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788359249.077807:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309696:0@lo:502: 00000040:00080000:0.0:1788359249.077843:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788359249.077851:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788359249.082263:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359249.082276:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359249.082279:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788359249.082287:0:9524:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaff1c4000 00000020:00000080:3.0:1788359249.082290:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788359249.082302:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359249.082304:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359249.082306:0:9524:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788359249.082309:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788359249.082469:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788359249.082529:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788359249.082548:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.082562:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359249.082613:0:9509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788359249.082622:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eaff1c4000 10000000:01000000:1.0:1788359249.082624:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eaff1c4000 10000000:01000000:1.0:1788359249.082627:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359249.082632:0:9509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaff1c4000 from 1 10000000:01000000:1.0:1788359249.082635:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788359249.082672:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.082678:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.082686:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.082706:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309824:0@lo:101: 00000100:00100000:1.0:1788359249.082766:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359249.082806:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309824 00000100:00100000:1.0:1788359249.082806:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.082813:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309824 00000100:00100000:2.0:1788359249.082861:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788359249.082871:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9509:x1875230445309824:12345-0@lo:101: 00010000:00010000:2.0:1788359249.082887:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359249.082900:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae357 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.082924:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae357 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.082935:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae357 expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359249.082944:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41e00, rc 0) 00000100:00100000:2.0:1788359249.083063:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445309824:12345-0@lo:101: Request processed in 193us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.083070:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788359249.083139:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309824:0@lo:101: 00010000:00010000:1.0:1788359249.083151:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.083157:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.083296:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309952:0@lo:501: 00000100:00100000:1.0:1788359249.083327:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.083354:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359249.083421:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445309952 00000100:00100000:3.0:1788359249.083426:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445309952 00000100:00100000:3.0:1788359249.083473:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788359249.083481:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445309952:12345-0@lo:501: 00000100:00100000:3.0:1788359249.083621:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445309952:12345-0@lo:501: Request processed in 141us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.083629:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788359249.084299:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445309952:0@lo:501: 00000100:00100000:1.0:1788359249.084344:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310080:0@lo:503: 00000100:00100000:1.0:1788359249.084399:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.084427:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.084433:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310080 00000100:00100000:2.0:1788359249.084438:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310080 00000100:00100000:2.0:1788359249.084483:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788359249.084491:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310080:12345-0@lo:503: 00000100:00100000:2.0:1788359249.084900:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310080:12345-0@lo:503: Request processed in 410us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.084915:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788359249.085141:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310080:0@lo:503: 00000040:00080000:1.0:1788359249.085464:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359249.085615:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310336:0@lo:502: 00000100:00100000:1.0:1788359249.085659:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.085686:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359249.086093:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445310208:0@lo:41: 00000100:00100000:0.0:1788359249.086139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.086339:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310208 00000100:00100000:1.0:1788359249.086346:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310208 00000100:00100000:3.0:1788359249.086591:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310336 00000100:00100000:3.0:1788359249.086595:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310336 00000100:00100000:3.0:1788359249.086630:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788359249.086639:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310336:12345-0@lo:502: 00000100:00100000:3.0:1788359249.086762:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310336:12345-0@lo:502: Request processed in 123us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.086770:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788359249.086797:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788359249.086804:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445310208:12345-0@lo:41: 00000100:00100000:3.0:1788359249.086831:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310336:0@lo:502: 00000004:00000024:1.0:1788359249.086831:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788359249.086870:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445310208:12345-0@lo:41: Request processed in 66us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.086876:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:3.0:1788359249.087098:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788359249.087127:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788359249.087143:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788359249.087155:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000100:00100000:0.0:1788359249.087155:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445310208:0@lo:41: 00000040:00080000:3.0:1788359249.087167:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788359249.087180:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788359249.087194:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788359249.087208:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788359249.087220:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788359249.087233:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788359249.087246:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788359249.087260:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788359249.087274:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788359249.087287:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788359249.087301:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788359249.087328:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788359249.087343:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788359249.087358:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788359249.087374:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788359249.087386:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788359249.087400:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788359249.087411:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788359249.087420:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788359249.087430:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788359249.087452:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788359249.087475:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788359249.087485:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788359249.087642:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788359249.087661:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788359249.087675:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788359249.087747:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788359249.087802:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788359249.087819:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788359249.087833:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788359249.087847:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788359249.087861:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788359249.087874:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788359249.087886:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788359249.087900:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788359249.087911:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788359249.087922:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788359249.087934:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788359249.087946:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788359249.087959:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788359249.087973:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788359249.087988:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788359249.088032:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310464:0@lo:502: 00000100:00100000:0.0:1788359249.088179:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.088271:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359249.088319:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310464 00000100:00100000:2.0:1788359249.088326:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310464 00000100:00100000:2.0:1788359249.088368:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359249.088377:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310464:12345-0@lo:502: 00000100:00100000:2.0:1788359249.088487:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445310464:12345-0@lo:502: Request processed in 111us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.088514:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788359249.088526:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6375c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445310464:0@lo:502: 00000040:00080000:0.0:1788359249.088567:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788359249.088576:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788359249.089107:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788359249.089129:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0e9c5618000) 00000020:00000080:3.0:1788359249.089151:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1788359249.089401:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaff1c4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359249.089405:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaff1c4000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359249.089408:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaff1c4000 3 00010000:00080000:3.0:1788359249.089432:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c712d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359249.092210:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1788359249.092438:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788359249.092573:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788359249.092589:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x49dd053b5feae36c 00000100:00080000:3.0:1788359249.092600:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359249.092606:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0e9c712d800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359249.092646:0:9525:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0eb006b1f80 x1875230445310592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788359249.092671:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788359249.092766:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445310592:0@lo:38: 00000100:00100000:0.0:1788359249.092845:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.092908:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445310848:0@lo:400: 00000100:00100000:0.0:1788359249.092936:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.092968:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445311360:0@lo:400: 00000100:00100000:3.0:1788359249.092980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310592 00000100:00100000:3.0:1788359249.092987:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310592 00000100:00100000:0.0:1788359249.092993:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.093013:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788359249.093019:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445310720:0@lo:400: 00000100:00100000:3.0:1788359249.093020:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788359249.093027:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445310592:12345-0@lo:38: 00000100:00100000:0.0:1788359249.093039:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788359249.093051:0:6515:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788359249.093088:0:6515:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x49dd053b5feae373 00000004:00100000:3.0:1788359249.093103:0:6515:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788359249.093145:0:6515:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359249.093198:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875230445310592:12345-0@lo:38: Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.093206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359249.093293:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445311232:0@lo:400: 00000100:00100000:2.0:1788359249.093297:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310848 00000100:00100000:2.0:1788359249.093301:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310848 00000100:00100000:0.0:1788359249.093328:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359249.093345:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359249.093352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445310848:12345-0@lo:400: 00000100:00100000:2.0:1788359249.093392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445310848:12345-0@lo:400: Request processed in 41us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.093398:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359249.093572:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445310976:0@lo:400: 00000020:01000004:2.0:1788359249.093673:0:9525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788359249.093688:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffffa0eafef799c0) 00000020:00000080:2.0:1788359249.093705:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788359249.093857:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaff1c4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788359249.093862:0:9525:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaff1c4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788359249.093864:0:9525:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaff1c4000 3 00010000:00080000:2.0:1788359249.093888:0:9525:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaffa88000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.152@tcp at head 00010000:00010000:2.0:1788359249.095725:0:9525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788359249.095826:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788359249.095872:0:9525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788359249.095885:0:9525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x49dd053b5feae381 00000100:00080000:2.0:1788359249.095908:0:9525:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788359249.095915:0:9525:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa0eaffa88000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359249.096082:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310720 00000100:00100000:3.0:1788359249.096091:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310720 00000100:00100000:3.0:1788359249.096142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788359249.096151:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445310720:12345-0@lo:400: 00000100:00100000:3.0:1788359249.096251:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445310720:12345-0@lo:400: Request processed in 100us (3209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.096258:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359249.096386:0:9525:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c7243100 x1875230445311616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359249.096402:0:9525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788359249.096527:0:9526:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffffa0e9c7242d80 x1875230445311744/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359249.096538:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead2976e40 going to sleep for 0 seconds 00010000:00080000:3.0:1788359249.096634:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eb006b1f80 x1875230445310592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359249.096648:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359249.096659:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788359249.096668:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788359249.096673:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788359249.096677:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788359249.096684:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f05b8697): req@ffffa0e9c7242d80 x1875230445311744/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359249.096813:0:9526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359249.096847:0:9526:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead2976e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359249.096879:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445310592:0@lo:38: 00000100:00100000:3.0:1788359249.096903:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445311616:0@lo:38: 00000040:00080000:3.0:1788359249.097269:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:2.0:1788359249.098671:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311360 00000100:00100000:2.0:1788359249.098683:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311360 00000100:00100000:2.0:1788359249.098752:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359249.098762:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445311360:12345-0@lo:400: 00000100:00100000:2.0:1788359249.098833:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445311360:12345-0@lo:400: Request processed in 73us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359249.098840:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359249.098890:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445311104:0@lo:400: 00000100:00080000:3.0:1788359249.098976:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359249.099140:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311744 00000100:00100000:1.0:1788359249.099146:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311744 00000100:00100000:1.0:1788359249.099225:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359249.099234:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1875230445311744:12345-0@lo:901: 00000100:00100000:1.0:1788359249.099329:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9526:x1875230445311744:12345-0@lo:901: Request processed in 97us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.099336:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788359249.099372:0:9526:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c7242d80 x1875230445311744/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788359265 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359249.099387:0:9526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9526:1875230445311744:0@lo:901: 00000100:00100000:0.0:1788359249.101847:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.101878:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445311488:0@lo:400: 00000100:00100000:0.0:1788359249.101928:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.101973:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311488 00000100:00100000:0.0:1788359249.101981:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311488 00000100:00100000:1.0:1788359249.102299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311232 00000100:00100000:1.0:1788359249.102309:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311232 00000100:00080000:3.0:1788359249.102407:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359249.102412:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359249.102414:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359249.102428:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445310976 00000100:00100000:3.0:1788359249.102431:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445310976 00000100:00100000:3.0:1788359249.102488:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788359249.102514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445310976:12345-0@lo:400: 00000100:00100000:3.0:1788359249.102576:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445310976:12345-0@lo:400: Request processed in 80us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.102597:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788359249.102638:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0e680 x1875230445310976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359249.102653:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445310976:0@lo:400: 00000100:00100000:3.0:1788359249.102678:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.102718:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311616 00000100:00100000:3.0:1788359249.102722:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311616 00000100:00100000:3.0:1788359249.102739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359249.102744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875230445311616:12345-0@lo:38: 00010000:00080000:3.0:1788359249.102765:0:6517:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:3.0:1788359249.102797:0:6517:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x49dd053b5feae388 00000004:00100000:3.0:1788359249.102811:0:6517:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788359249.102840:0:6517:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359249.102876:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875230445311616:12345-0@lo:38: Request processed in 131us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.102883:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788359249.102908:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c7243100 x1875230445311616/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359249.102917:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359249.102924:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788359249.102930:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788359249.102935:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788359249.102938:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa88000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788359249.102943:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7243100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445311616:0@lo:38: 00000100:00100000:0.0:1788359249.103246:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359249.103254:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445311488:12345-0@lo:400: 00000100:00100000:0.0:1788359249.103292:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445311488:12345-0@lo:400: Request processed in 39us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359249.103298:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359249.103322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788359249.103355:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788359249.103395:0:9509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359249.103409:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.103420:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788359249.103518:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788359249.103520:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788359249.103526:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359249.103528:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359249.103529:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359249.103530:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359249.103531:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359249.103533:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359249.103534:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359249.103536:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359249.103537:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359249.103540:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788359249.103543:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788359249.103544:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788359249.103545:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359249.103546:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359249.103547:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359249.103548:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359249.103548:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359249.103549:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788359249.103550:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788359249.103551:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359249.103552:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788359249.103570:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788359249.103583:0:9509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445311872:0@lo:253: 00000100:00100000:0.0:1788359249.103619:0:9509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.103639:0:9509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb56c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788359249.103664:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c7240e00 x1875230445311360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359249.103674:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445311360:0@lo:400: 00000100:00100000:0.0:1788359249.103686:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445310848:0@lo:400: 00010000:00080000:0.0:1788359249.103707:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaece0ea00 x1875230445310720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359249.103714:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445310720:0@lo:400: 00010000:00080000:3.0:1788359249.104080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c7242680 x1875230445311488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359249.104097:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445311488:0@lo:400: 00000100:00100000:3.0:1788359249.104115:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311104 00000100:00100000:3.0:1788359249.104119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311104 00000100:00100000:3.0:1788359249.104146:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788359249.104153:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445311104:12345-0@lo:400: 00000100:00100000:3.0:1788359249.104191:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445311104:12345-0@lo:400: Request processed in 39us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.104197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788359249.104214:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445311872 00000100:00100000:3.0:1788359249.104217:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445311872 00000100:00100000:3.0:1788359249.104238:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788359249.104243:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445311872:12345-0@lo:253: 20000000:01000000:3.0:1788359249.104260:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788359249.104272:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788359249.104388:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2753480 x1875230445311104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359249.104397:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445311104:0@lo:400: 00000100:00080000:3.0:1788359249.104414:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359249.108164:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359249.108182:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445311232:12345-0@lo:400: 00000100:00100000:1.0:1788359249.108277:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445311232:12345-0@lo:400: Request processed in 101us (14947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.108284:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788359249.108333:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c7243800 x1875230445311232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359249.108349:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7243800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445311232:0@lo:400: 20000000:01000000:3.0:1788359249.113367:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788359249.113392:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788359249.113698:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9509:x1875230445311872:12345-0@lo:253: Request processed in 9449us (10073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.113710:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788359249.113781:0:9509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9509:1875230445311872:0@lo:253: 10000000:01000000:3.0:1788359249.113795:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788359249.113811:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788359249.113813:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788359249.113814:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359249.113816:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359249.113817:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359249.113818:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359249.113820:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788359249.113821:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788359249.113823:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788359249.113824:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359249.113826:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788359249.113844:0:9509:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788359249.115300:0:6531:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788359249.115317:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788359249.115340:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115357:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115365:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115373:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115413:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 16 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115429:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 16 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.115442:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445312000:0@lo:104: 00000100:00100000:0.0:1788359249.115522:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359249.115570:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.115578:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.115586:0:6531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445312128:0@lo:104: 00000100:00100000:0.0:1788359249.115606:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359249.115621:0:6531:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359249.115848:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312000 00000100:00100000:1.0:1788359249.115857:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312000 00000100:00100000:1.0:1788359249.115932:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312128 00000100:00100000:1.0:1788359249.115936:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312128 00000100:00100000:1.0:1788359249.115964:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359249.115973:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445312000:12345-0@lo:104: 00010000:00010000:1.0:1788359249.115985:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.116183:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445312000:0@lo:104: 00010000:00010000:1.0:1788359249.116231:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359249.116238:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:6531:x1875230445312000:12345-0@lo:104: Request processed in 267us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.116246:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359249.116264:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788359249.116270:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445312128:12345-0@lo:104: 00010000:00010000:1.0:1788359249.116278:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116318:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359249.116329:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:6531:x1875230445312128:12345-0@lo:104: Request processed in 60us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.116334:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788359249.116358:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359249.116364:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116371:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359249.116375:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116384:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359249.116391:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359249.116397:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359249.116425:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116432:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359249.116451:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116469:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae2c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae2cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116481:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359249.116484:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116523:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359249.116526:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116533:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359249.116539:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359249.116544:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359249.116573:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116580:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359249.116594:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116601:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae285 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116614:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359249.116615:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359249.116617:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359249.116631:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359249.116643:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445312256:0@lo:103: 00000100:00100000:1.0:1788359249.116674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.116708:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445312384:0@lo:103: 00000100:00100000:1.0:1788359249.116741:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359249.116773:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312256 00000100:00100000:1.0:1788359249.116777:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312256 00010000:00010000:1.0:1788359249.116794:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 17 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.116820:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312384 00000100:00100000:1.0:1788359249.116823:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312384 00010000:00010000:1.0:1788359249.116834:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 18 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359249.116851:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359249.116857:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3644:x1875230445312256:12345-0@lo:103: 00010000:00010000:1.0:1788359249.116866:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359249.116871:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 18 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116881:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 18 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116894:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae2cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae2c4 expref: 18 pid: 6508 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.116904:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359249.116931:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:3644:x1875230445312256:12345-0@lo:103: Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.116937:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359249.116950:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788359249.117097:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359249.118127:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3642:x1875230445312384:12345-0@lo:103: 00010000:00010000:1.0:1788359249.118166:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359249.118180:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118195:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 16 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118213:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118222:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788359249.118237:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005756717s 00010000:00010000:1.0:1788359249.118242:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118249:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118256:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118263:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118269:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359249.118274:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118280:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118289:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359249.118304:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359249.119547:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:3642:x1875230445312384:12345-0@lo:103: Request processed in 2583us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359249.119558:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788359249.119581:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae27e expref: 15 pid: 6510 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359249.119599:0:6531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6531:1875230445312128:0@lo:104: 00000100:00100000:1.0:1788359249.119600:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445312256:0@lo:103: 00010000:00010000:0.0:1788359249.119623:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.119634:0:6531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.119640:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359249.119646:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae38f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788359249.121353:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788359249.121583:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788359249.121780:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788359249.121933:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788359249.122297:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788359249.122550:0:9509:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1788359249.122709:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445312384:0@lo:103: 00000001:00000004:3.0:1788359249.124190:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788359249.136588:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788359249.136599:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788359249.136643:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788359249.136684:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788359249.136702:0:9509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788359249.136725:0:9509:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788359249.137466:0:9509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359249.137654:0:9509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788359249.284676:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359249.596663:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445312512:0@lo:41: 00000100:00100000:1.0:1788359249.596719:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359249.596909:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312512 00000100:00100000:3.0:1788359249.596917:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312512 00000100:00100000:3.0:1788359249.596972:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359249.596982:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445312512:12345-0@lo:41: 00000004:00000024:3.0:1788359249.597026:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788359249.597161:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445312512:12345-0@lo:41: Request processed in 181us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359249.597173:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788359249.597219:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445312512:0@lo:41: 00000020:00000004:2.0:1788359249.954118:0:9581:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359249.954671:0:9581:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359250.301069:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359251.325406:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359251.645681:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359251.645708:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445312640:0@lo:13: 00000100:00100000:3.0:1788359251.645787:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359251.645851:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312640 00000100:00100000:3.0:1788359251.645858:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312640 00000100:00100000:3.0:1788359251.645913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359251.645923:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445312640:12345-0@lo:13: 00002000:00000024:3.0:1788359251.645956:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359251.646013:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445312640:12345-0@lo:13: Request processed in 92us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359251.646021:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788359251.646042:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788359251.646067:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b1180 x1875230445312640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359251.646085:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445312640:0@lo:13: 00000100:00100000:3.0:1788359251.657672:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359251.657699:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445312768:0@lo:13: 00000100:00100000:3.0:1788359251.657777:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359251.657834:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312768 00000100:00100000:3.0:1788359251.657841:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312768 00000100:00100000:3.0:1788359251.657891:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788359251.657899:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445312768:12345-0@lo:13: 00002000:00000024:3.0:1788359251.657920:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359251.657962:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445312768:12345-0@lo:13: Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359251.657999:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788359251.658020:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788359251.658045:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b1180 x1875230445312768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359251.658064:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445312768:0@lo:13: 00010000:00010000:0.0:1788359252.348847:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359253.372996:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359254.204867:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445312896:0@lo:41: 00000100:00100000:2.0:1788359254.204945:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.205040:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445312896 00000100:00100000:2.0:1788359254.205047:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445312896 00000100:00100000:2.0:1788359254.205093:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788359254.205109:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445312896:12345-0@lo:41: 00000004:00000024:2.0:1788359254.205143:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788359254.205205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445312896:12345-0@lo:41: Request processed in 98us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.205212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788359254.205744:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445313152:0@lo:400: 00000100:00100000:2.0:1788359254.205783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359254.205805:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445313024:0@lo:400: 00000100:00100000:2.0:1788359254.205811:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445313664:0@lo:400: 00000100:00100000:2.0:1788359254.206761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.206806:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445314176:0@lo:400: 00000100:00100000:2.0:1788359254.206846:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.206878:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788359254.206886:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445313280:0@lo:400: 00000100:00100000:2.0:1788359254.206925:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.206947:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445313792:0@lo:400: 00000100:00100000:2.0:1788359254.206974:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.207023:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313152 00000100:00100000:2.0:1788359254.207030:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313152 00000100:00100000:2.0:1788359254.207067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313664 00000100:00100000:2.0:1788359254.207070:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313664 00000100:00100000:2.0:1788359254.207104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314176 00000100:00100000:2.0:1788359254.207107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314176 00000100:00100000:2.0:1788359254.207125:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359254.207132:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445313152:12345-0@lo:400: 00000100:00100000:2.0:1788359254.207368:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445313152:12345-0@lo:400: Request processed in 234us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.207376:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359254.207403:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359254.207582:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445313664:12345-0@lo:400: 00000100:00100000:2.0:1788359254.207616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445313664:12345-0@lo:400: Request processed in 36us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.207623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359254.207636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359254.207642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445314176:12345-0@lo:400: 00000100:00100000:2.0:1788359254.207732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445314176:12345-0@lo:400: Request processed in 90us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.207738:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359254.207780:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313280 00000100:00100000:2.0:1788359254.207785:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313280 00000100:00100000:2.0:1788359254.207810:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788359254.207816:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445313280:12345-0@lo:400: 00000100:00100000:2.0:1788359254.207849:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445313280:12345-0@lo:400: Request processed in 33us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.207854:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788359254.207872:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313792 00000100:00100000:2.0:1788359254.207876:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313792 00000100:00100000:2.0:1788359254.207961:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359254.207969:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445313792:12345-0@lo:400: 00000100:00100000:2.0:1788359254.208002:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445313792:12345-0@lo:400: Request processed in 35us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.208007:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788359254.208024:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359254.208029:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359254.208046:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445313408:0@lo:400: 00000100:00100000:2.0:1788359254.208099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.208123:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445313920:0@lo:400: 00000100:00100000:2.0:1788359254.208144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.208256:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445312896:0@lo:41: 00000100:00100000:2.0:1788359254.208287:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313920 00000100:00100000:2.0:1788359254.208289:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313920 00000100:00100000:2.0:1788359254.208318:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788359254.208325:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445313920:12345-0@lo:400: 00000100:00100000:2.0:1788359254.208357:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445313920:12345-0@lo:400: Request processed in 33us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.208363:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788359254.208378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788359254.208399:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7240a80 x1875230445313920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.208422:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445313920:0@lo:400: 00000100:00100000:2.0:1788359254.208448:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445313280:0@lo:400: 00010000:00080000:2.0:1788359254.208459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7243480 x1875230445313792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.208467:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445313792:0@lo:400: 00010000:00080000:2.0:1788359254.208478:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7240380 x1875230445313152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.208487:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445313152:0@lo:400: 00010000:00080000:2.0:1788359254.208516:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7241880 x1875230445313664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.208535:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445313664:0@lo:400: 00010000:00080000:2.0:1788359254.208549:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7240000 x1875230445314176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.208557:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445314176:0@lo:400: 00000100:00100000:2.0:1788359254.209866:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313408 00000100:00100000:2.0:1788359254.209885:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313408 00000100:00100000:2.0:1788359254.210288:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359254.210298:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445313408:12345-0@lo:400: 00000100:00100000:2.0:1788359254.210374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445313408:12345-0@lo:400: Request processed in 79us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.210380:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788359254.210437:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7241f80 x1875230445313408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359254.210451:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445313408:0@lo:400: 00000100:00100000:0.0:1788359254.212819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359254.212890:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445313536:0@lo:400: 00000100:00100000:0.0:1788359254.212948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359254.212965:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445314048:0@lo:400: 00000100:00100000:0.0:1788359254.212977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359254.213008:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313536 00000100:00100000:0.0:1788359254.213015:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313536 00000100:00100000:0.0:1788359254.213061:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314048 00000100:00100000:0.0:1788359254.213064:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314048 00000100:00100000:0.0:1788359254.213109:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788359254.213118:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788359254.213120:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445313536:12345-0@lo:400: 00000100:00100000:2.0:1788359254.213134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445314048:12345-0@lo:400: 00000100:00100000:0.0:1788359254.213188:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445313536:12345-0@lo:400: Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359254.213195:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788359254.213219:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788359254.213244:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7242a00 x1875230445313536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359254.213257:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445313536:0@lo:400: 00000100:00100000:1.0:1788359254.213597:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445313024 00000100:00100000:1.0:1788359254.213602:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445313024 00000100:00100000:1.0:1788359254.213633:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788359254.213639:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3643:x1875230445313024:12345-0@lo:400: 00000100:00100000:1.0:1788359254.213668:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3643:x1875230445313024:12345-0@lo:400: Request processed in 30us (7811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359254.213672:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788359254.215824:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445314048:12345-0@lo:400: Request processed in 2686us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359254.215838:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788359254.216354:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7243b80 x1875230445314048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359254.216368:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445314048:0@lo:400: 00000100:00100000:0.0:1788359254.216397:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445313024:0@lo:400: 00010000:00010000:2.0:1788359254.397860:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359254.723844:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359254.723873:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445314304:0@lo:41: 00000100:00100000:0.0:1788359254.724227:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359254.724360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314304 00000100:00100000:2.0:1788359254.724368:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314304 00000100:00100000:0.0:1788359254.724675:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788359254.724686:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445314304:12345-0@lo:41: 00000004:00000024:0.0:1788359254.724724:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788359254.724776:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445314304:12345-0@lo:41: Request processed in 93us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359254.724784:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788359254.724986:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445314304:0@lo:41: 00000001:02000400:3.0:1788359254.848538:0:9871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788359255.431178:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359255.636455:0:9923:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359255.636778:0:9923:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788359256.444695:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359256.764843:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445314432:0@lo:13: 00000100:00100000:0.0:1788359256.764907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788359256.765030:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788359256.765035:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6d76800 from 39 10000000:01000000:1.0:1788359256.765039:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788359256.765072:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.765083:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.765095:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359256.765101:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314432 00000100:00100000:3.0:1788359256.765108:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314432 00000100:00100000:1.0:1788359256.765126:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314560:0@lo:101: 00000100:00100000:1.0:1788359256.765155:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359256.765222:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359256.765237:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359256.765254:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445314688:0@lo:13: 00000100:00100000:1.0:1788359256.765259:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.765555:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788359256.765568:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445314432:12345-0@lo:13: 00002000:00000024:3.0:1788359256.765596:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359256.765754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.766054:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445314432:12345-0@lo:13: Request processed in 488us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.766063:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788359256.766079:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314688 00000100:00100000:3.0:1788359256.766083:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314688 00000100:00100000:3.0:1788359256.766166:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788359256.766172:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445314688:12345-0@lo:13: 00002000:00000024:3.0:1788359256.766185:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359256.766213:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445314688:12345-0@lo:13: Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.766219:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788359256.766240:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314560 00000100:00100000:3.0:1788359256.766243:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314560 00000100:00100000:3.0:1788359256.766296:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788359256.766303:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445314560:12345-0@lo:101: 00010000:00010000:3.0:1788359256.766312:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359256.766327:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae396 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.766350:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae396 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.766362:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae396 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.766372:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:3.0:1788359256.766439:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445314560:12345-0@lo:101: Request processed in 137us (1282us total) trans 0 rc 0/0 00010000:00080000:0.0:1788359256.766443:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bc000 x1875230445314688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.766445:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788359256.766461:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445314688:0@lo:13: 00010000:00080000:0.0:1788359256.766472:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b1180 x1875230445314432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.766483:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445314432:0@lo:13: 00000100:00100000:3.0:1788359256.766484:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314560:0@lo:101: 00010000:00010000:3.0:1788359256.766516:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.766526:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359256.766585:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314816:0@lo:501: 00000100:00100000:3.0:1788359256.766623:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.766721:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.766956:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314816 00000100:00100000:0.0:1788359256.766961:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314816 00000100:00100000:0.0:1788359256.767007:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788359256.767014:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445314816:12345-0@lo:501: 00000100:00100000:0.0:1788359256.767142:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445314816:12345-0@lo:501: Request processed in 128us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.767149:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788359256.767182:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314816:0@lo:501: 00000100:00100000:0.0:1788359256.767210:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314944:0@lo:503: 00000100:00100000:0.0:1788359256.767250:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.767401:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead2976600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.767415:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445314944 00000100:00100000:0.0:1788359256.767419:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445314944 00000100:00100000:0.0:1788359256.767442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788359256.767448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445314944:12345-0@lo:503: 00000100:00100000:0.0:1788359256.767556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445314944:12345-0@lo:503: Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.767573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788359256.767608:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445314944:0@lo:503: 00000100:00100000:2.0:1788359256.768488:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9975:1875230445315072:0@lo:502: 00000100:00100000:2.0:1788359256.768555:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.768589:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.768618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315072 00000100:00100000:0.0:1788359256.768623:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315072 00000100:00100000:0.0:1788359256.768659:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788359256.768667:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9975:x1875230445315072:12345-0@lo:502: 00000100:00100000:0.0:1788359256.768775:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9975:x1875230445315072:12345-0@lo:502: Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.768783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788359256.768852:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359256.768867:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9975:1875230445315072:0@lo:502: 00000100:00100000:3.0:1788359256.768907:0:9975:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9975:1875230445315200:0@lo:502: 00000100:00100000:3.0:1788359256.768939:0:9975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.768957:0:9975:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.769077:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315200 00000100:00100000:0.0:1788359256.769080:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315200 00000100:00100000:0.0:1788359256.769102:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788359256.769109:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9975:x1875230445315200:12345-0@lo:502: 00000100:00100000:0.0:1788359256.769182:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:9975:x1875230445315200:12345-0@lo:502: Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.769189:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788359256.769251:0:9975:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9975:1875230445315200:0@lo:502: 00000040:00080000:3.0:1788359256.769275:0:9975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788359256.769423:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788359256.769449:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359256.769458:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.769468:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359256.769476:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788359256.769479:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788359256.769481:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788359256.769669:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.769678:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.769686:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359256.769697:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315328:0@lo:101: 00000100:00100000:0.0:1788359256.769725:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.769793:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.770444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315328 00000100:00100000:3.0:1788359256.770451:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315328 00000100:00100000:3.0:1788359256.771341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788359256.771354:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445315328:12345-0@lo:101: 00010000:00010000:3.0:1788359256.771367:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359256.771454:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae3a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.771481:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.771513:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.771522:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4a00, rc 0) 00000100:00100000:3.0:1788359256.771880:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315328:12345-0@lo:101: Request processed in 529us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.771887:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788359256.777395:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315328:0@lo:101: 00010000:00010000:0.0:1788359256.777435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.777448:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359256.777556:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315456:0@lo:501: 00000100:00100000:0.0:1788359256.777617:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.777669:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.778123:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315456 00000100:00100000:1.0:1788359256.778132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315456 00000100:00100000:1.0:1788359256.778189:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788359256.778198:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315456:12345-0@lo:501: 00000100:00100000:1.0:1788359256.778359:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315456:12345-0@lo:501: Request processed in 162us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.778366:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788359256.778555:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315456:0@lo:501: 00000100:00100000:0.0:1788359256.778588:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315584:0@lo:503: 00000100:00100000:0.0:1788359256.778635:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.778660:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.778728:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315584 00000100:00100000:2.0:1788359256.778733:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315584 00000100:00100000:2.0:1788359256.778767:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788359256.778775:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315584:12345-0@lo:503: 00000100:00100000:2.0:1788359256.778918:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315584:12345-0@lo:503: Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.778924:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788359256.779121:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315584:0@lo:503: 00000100:00100000:1.0:1788359256.787720:0:9976:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9976:1875230445315712:0@lo:502: 00000100:00100000:1.0:1788359256.787832:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.787880:0:9976:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.788669:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315712 00000100:00100000:3.0:1788359256.788680:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315712 00000100:00100000:3.0:1788359256.788741:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788359256.788751:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9976:x1875230445315712:12345-0@lo:502: 00000100:00100000:3.0:1788359256.788884:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9976:x1875230445315712:12345-0@lo:502: Request processed in 133us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.788900:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788359256.790719:0:9976:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9976:1875230445315712:0@lo:502: 00000020:01000000:0.0:1788359256.790778:0:9976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359256.790788:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359256.790791:0:9976:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788359256.790795:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788359256.790797:0:9976:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788359256.790829:0:9976:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9976:1875230445315840:0@lo:502: 00000100:00100000:0.0:1788359256.790890:0:9976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.790933:0:9976:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.791001:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315840 00000100:00100000:1.0:1788359256.791008:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315840 00000100:00100000:1.0:1788359256.791051:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788359256.791060:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9976:x1875230445315840:12345-0@lo:502: 00000100:00100000:1.0:1788359256.791163:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:9976:x1875230445315840:12345-0@lo:502: Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.791171:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788359256.791252:0:9976:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9976:1875230445315840:0@lo:502: 00000020:01000000:0.0:1788359256.791283:0:9976:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359256.791288:0:9976:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359256.791289:0:9976:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788359256.791293:0:9976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788359256.791542:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788359256.791568:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788359256.791579:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.791591:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.791601:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788359256.791603:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6cef800 from 39 10000000:01000000:2.0:1788359256.791606:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359256.791632:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.791641:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.791650:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.791671:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315968:0@lo:101: 00000100:00100000:2.0:1788359256.791703:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.791727:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.791918:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445315968 00000100:00100000:0.0:1788359256.791924:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445315968 00000100:00100000:0.0:1788359256.791959:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788359256.791976:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445315968:12345-0@lo:101: 00010000:00010000:0.0:1788359256.791986:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.791999:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae3b2 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.792022:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.792034:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 18 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.792042:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a600, rc 0) 00000100:00100000:0.0:1788359256.792072:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445315968:12345-0@lo:101: Request processed in 106us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.792084:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788359256.792191:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445315968:0@lo:101: 00010000:00010000:2.0:1788359256.792205:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.792213:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.792280:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316096:0@lo:501: 00000100:00100000:2.0:1788359256.792307:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.792329:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.792479:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316096 00000100:00100000:0.0:1788359256.792484:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316096 00000100:00100000:0.0:1788359256.792530:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788359256.792536:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445316096:12345-0@lo:501: 00000100:00100000:0.0:1788359256.792648:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445316096:12345-0@lo:501: Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.792655:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788359256.792757:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316096:0@lo:501: 00000100:00100000:3.0:1788359256.792787:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316224:0@lo:503: 00000100:00100000:3.0:1788359256.792823:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.792856:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.792897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316224 00000100:00100000:0.0:1788359256.792902:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316224 00000100:00100000:0.0:1788359256.792935:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788359256.792942:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445316224:12345-0@lo:503: 00000100:00100000:0.0:1788359256.793037:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445316224:12345-0@lo:503: Request processed in 95us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.793044:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788359256.793164:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316224:0@lo:503: 00000100:00100000:3.0:1788359256.793774:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9977:1875230445316352:0@lo:502: 00000100:00100000:3.0:1788359256.793816:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.793847:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.793894:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316352 00000100:00100000:2.0:1788359256.793899:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316352 00000100:00100000:2.0:1788359256.793935:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788359256.793944:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:9977:x1875230445316352:12345-0@lo:502: 00000100:00100000:2.0:1788359256.794048:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:9977:x1875230445316352:12345-0@lo:502: Request processed in 104us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.794056:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788359256.794185:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9977:1875230445316352:0@lo:502: 00000100:00100000:3.0:1788359256.794233:0:9977:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9977:1875230445316480:0@lo:502: 00000100:00100000:3.0:1788359256.794281:0:9977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.794300:0:9977:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.796098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316480 00000100:00100000:0.0:1788359256.796115:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316480 00000100:00100000:0.0:1788359256.796181:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788359256.796190:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:9977:x1875230445316480:12345-0@lo:502: 00000100:00100000:0.0:1788359256.796356:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:9977:x1875230445316480:12345-0@lo:502: Request processed in 167us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.796364:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788359256.796571:0:9977:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9977:1875230445316480:0@lo:502: 00000040:00080000:1.0:1788359256.796672:0:9977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788359256.797062:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788359256.797089:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359256.797099:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.797112:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.797130:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359256.797133:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaf6cef800 from 6 10000000:01000000:2.0:1788359256.797136:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359256.797173:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.797181:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.797190:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.797207:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316608:0@lo:101: 00000100:00100000:2.0:1788359256.797248:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.797292:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.797411:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316608 00000100:00100000:3.0:1788359256.797417:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316608 00000100:00100000:3.0:1788359256.797456:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788359256.797465:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445316608:12345-0@lo:101: 00010000:00010000:3.0:1788359256.797474:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359256.797489:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae3c0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.797546:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae3c0 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.797556:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3c0 expref: 19 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.797572:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031600, rc 0) 00000100:00100000:3.0:1788359256.797608:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445316608:12345-0@lo:101: Request processed in 144us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.797615:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788359256.797796:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316608:0@lo:101: 00010000:00010000:2.0:1788359256.797809:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.797818:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.797863:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316736:0@lo:256: 00000100:00100000:2.0:1788359256.797895:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.797924:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.797983:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316736 00000100:00100000:0.0:1788359256.797988:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316736 00000100:00100000:0.0:1788359256.798019:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788359256.798027:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445316736:12345-0@lo:256: 20000000:01000000:0.0:1788359256.798048:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788359256.798062:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788359256.798065:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788359256.798152:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445316736:12345-0@lo:256: Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.798159:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788359256.798288:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316736:0@lo:256: 10000000:01000000:2.0:1788359256.798330:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359256.798340:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.798348:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.798355:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788359256.798356:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788359256.798358:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788359256.798371:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.798376:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.798395:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.798408:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316864:0@lo:101: 00000100:00100000:2.0:1788359256.798439:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.798458:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.798571:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316864 00000100:00100000:0.0:1788359256.798576:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316864 00000100:00100000:0.0:1788359256.798605:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788359256.798612:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445316864:12345-0@lo:101: 00010000:00010000:0.0:1788359256.798619:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.798630:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae3ce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.798643:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.798652:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.798659:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14be00, rc 0) 00000100:00100000:0.0:1788359256.798695:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445316864:12345-0@lo:101: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.798702:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788359256.799159:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316864:0@lo:101: 00010000:00010000:1.0:1788359256.799170:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.799183:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359256.799222:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316992:0@lo:501: 00000100:00100000:1.0:1788359256.799244:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.799267:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4e546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.799328:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445316992 00000100:00100000:0.0:1788359256.799334:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445316992 00000100:00100000:0.0:1788359256.799365:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788359256.799373:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445316992:12345-0@lo:501: 00000100:00100000:0.0:1788359256.799683:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445316992:12345-0@lo:501: Request processed in 310us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.799695:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788359256.799851:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445316992:0@lo:501: 00000100:00100000:1.0:1788359256.799879:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445317120:0@lo:503: 00000100:00100000:1.0:1788359256.799910:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.799931:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4e546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.799949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317120 00000100:00100000:2.0:1788359256.799954:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317120 00000100:00100000:2.0:1788359256.799997:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788359256.800004:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445317120:12345-0@lo:503: 00000100:00100000:2.0:1788359256.800135:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445317120:12345-0@lo:503: Request processed in 131us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.800141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788359256.800336:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445317120:0@lo:503: 00000100:00100000:1.0:1788359256.800910:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9978:1875230445317248:0@lo:502: 00000100:00100000:1.0:1788359256.800952:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.800993:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4e54f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.801085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317248 00000100:00100000:0.0:1788359256.801091:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317248 00000100:00100000:0.0:1788359256.801126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788359256.801134:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:9978:x1875230445317248:12345-0@lo:502: 00000100:00100000:0.0:1788359256.801234:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:9978:x1875230445317248:12345-0@lo:502: Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.801241:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788359256.801577:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9978:1875230445317248:0@lo:502: 00000020:01000000:1.0:1788359256.801604:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788359256.801612:0:9978:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788359256.801620:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359256.801622:0:9978:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788359256.801627:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788359256.801630:0:9978:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:1.0:1788359256.801654:0:9978:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788359256.801657:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788359256.801691:0:9978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffffa0e9c6874d40) 00000020:00000080:1.0:1788359256.801717:0:9978:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788359256.801730:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788359256.801817:0:9978:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788359256.801825:0:9978:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788359256.801832:0:9978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feae3e3 00010000:00080000:1.0:1788359256.801870:0:9978:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c745c800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359256.802188:0:9978:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788359256.802342:0:9978:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788359256.802355:0:9978:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788359256.802779:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359256.802897:0:9978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359256.803178:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788359256.803358:0:9978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788359256.803856:0:9979:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359256.803862:0:9979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788359256.804788:0:9978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788359256.804800:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788359256.804839:0:9978:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788359256.804865:0:9978:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae3ea 00000100:00080000:1.0:1788359256.804876:0:9978:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359256.804883:0:9978:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0e9c745c800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359256.804921:0:9978:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c7395c00 x1875230445317376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788359256.804998:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445317376:0@lo:8: 00000100:00100000:3.0:1788359256.805066:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.805222:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317376 00000100:00100000:2.0:1788359256.805230:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317376 00000100:00100000:2.0:1788359256.805290:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359256.805296:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445317376:12345-0@lo:8: 00010000:00080000:2.0:1788359256.805321:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1788359256.805343:0:8430:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feae3f1 00002000:00100000:2.0:1788359256.805355:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffffa0eaffa8c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788359256.805359:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788359256.805362:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788359256.805561:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788359256.805764:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788359256.805788:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa8b000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788359256.805921:0:9978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788359256.806038:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445317888:0@lo:400: 00000100:00100000:1.0:1788359256.806074:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.806098:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445318400:0@lo:400: 00000100:00100000:1.0:1788359256.806126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.806145:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788359256.806151:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445317760:0@lo:400: 00000100:00100000:1.0:1788359256.806172:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.806186:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445318272:0@lo:400: 00000100:00100000:1.0:1788359256.806217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788359256.806407:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359256.806413:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359256.806415:0:9978:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788359256.806418:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359256.806422:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359256.806424:0:9978:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788359256.806426:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359256.806428:0:9978:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788359256.806453:0:9978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9978:1875230445318528:0@lo:502: 00000100:00100000:1.0:1788359256.806515:0:9978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.806540:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318528 00000100:00100000:1.0:1788359256.806545:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318528 00000100:00100000:1.0:1788359256.806575:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788359256.806582:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:9978:x1875230445318528:12345-0@lo:502: 00000100:00100000:1.0:1788359256.806679:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:9978:x1875230445318528:12345-0@lo:502: Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.806686:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788359256.806729:0:9978:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.806748:0:9978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9978:1875230445318528:0@lo:502: 00000020:01000000:1.0:1788359256.806771:0:9978:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359256.806775:0:9978:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359256.806777:0:9978:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788359256.806781:0:9978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1788359256.806964:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445317504:0@lo:400: 00000100:00100000:0.0:1788359256.806996:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.807021:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445318016:0@lo:400: 00000100:00100000:0.0:1788359256.807043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.807057:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788359256.807062:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445317632:0@lo:400: 00000100:00100000:0.0:1788359256.807082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.807100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445318144:0@lo:400: 00000100:00100000:0.0:1788359256.807120:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.807149:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318400 00000100:00100000:0.0:1788359256.807153:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318400 00000100:00100000:0.0:1788359256.807187:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317760 00000100:00100000:0.0:1788359256.807190:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317760 00000100:00100000:0.0:1788359256.807203:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318272 00000100:00100000:0.0:1788359256.807205:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318272 00000100:00100000:0.0:1788359256.807216:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317504 00000100:00100000:0.0:1788359256.807218:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317504 00000100:00100000:0.0:1788359256.807227:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318016 00000100:00100000:0.0:1788359256.807229:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318016 00000100:00100000:0.0:1788359256.807238:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318144 00000100:00100000:0.0:1788359256.807249:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318144 00000100:00100000:0.0:1788359256.807279:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359256.807287:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445318400:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807328:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445318400:12345-0@lo:400: Request processed in 42us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807334:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359256.807349:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788359256.807354:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445317760:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807394:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445317760:12345-0@lo:400: Request processed in 28us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807400:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788359256.807411:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788359256.807417:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445318272:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807443:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445318272:12345-0@lo:400: Request processed in 26us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807448:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788359256.807457:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788359256.807462:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445317504:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807489:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445317504:12345-0@lo:400: Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807516:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788359256.807527:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788359256.807533:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445318016:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807559:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445318016:12345-0@lo:400: Request processed in 26us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807564:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788359256.807584:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788359256.807589:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445318144:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807617:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445318144:12345-0@lo:400: Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807623:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788359256.807648:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317888 00000100:00100000:0.0:1788359256.807652:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317888 00000100:00100000:0.0:1788359256.807673:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445317632 00000100:00100000:0.0:1788359256.807676:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445317632 00000100:00100000:0.0:1788359256.807688:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788359256.807693:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445317888:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807723:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445317888:12345-0@lo:400: Request processed in 30us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807729:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788359256.807741:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788359256.807746:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445317632:12345-0@lo:400: 00000100:00100000:0.0:1788359256.807771:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445317632:12345-0@lo:400: Request processed in 25us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.807777:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788359256.807792:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359256.807796:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788359256.807821:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7394380 x1875230445317760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.807833:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445317760:0@lo:400: 00010000:00080000:0.0:1788359256.807844:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7395880 x1875230445318272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.807851:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445318272:0@lo:400: 00000100:00100000:0.0:1788359256.807871:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445317888:0@lo:400: 00010000:00080000:0.0:1788359256.807884:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7397480 x1875230445318400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.807892:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445318400:0@lo:400: 00000100:00100000:0.0:1788359256.808025:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445317632:0@lo:400: 00010000:00080000:0.0:1788359256.808035:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7396a00 x1875230445318144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.808043:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445318144:0@lo:400: 00010000:00080000:0.0:1788359256.808053:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7395500 x1875230445317504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.808060:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445317504:0@lo:400: 00010000:00080000:0.0:1788359256.808068:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7395f80 x1875230445318016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.808075:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445318016:0@lo:400: 00000100:00100000:2.0:1788359256.808486:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445317376:12345-0@lo:8: Request processed in 3186us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.808519:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:2.0:1788359256.808547:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788359256.808577:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788359256.808588:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.808600:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.808611:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788359256.808614:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eae4e42000 from 39 10000000:01000000:2.0:1788359256.808617:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359256.808648:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.808656:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.808681:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.808698:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445318656:0@lo:101: 00000100:00100000:2.0:1788359256.808740:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.808771:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.808848:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318656 00000100:00100000:0.0:1788359256.808853:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318656 00000100:00100000:0.0:1788359256.808883:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788359256.808890:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445318656:12345-0@lo:101: 00010000:00010000:0.0:1788359256.808900:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.808911:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae3f8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.808933:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.808949:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.808958:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a400, rc 0) 00000100:00100000:0.0:1788359256.809057:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445318656:12345-0@lo:101: Request processed in 167us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.809063:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788359256.810145:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445318656:0@lo:101: 00010000:00010000:2.0:1788359256.810166:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.810177:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.810250:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445318784:0@lo:501: 00010000:00080000:3.0:1788359256.810682:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7395c00 x1875230445317376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.810693:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359256.810701:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788359256.810707:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788359256.810712:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788359256.810716:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c745c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788359256.810734:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788359256.810740:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445317376:0@lo:8: 00000100:00100000:3.0:1788359256.810783:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445318912:0@lo:700: 00000100:00100000:3.0:1788359256.810826:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.810860:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a240 going to sleep for 11 seconds 00000004:00080000:0.0:1788359256.810909:0:9979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788359256.810990:0:9979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 288781494417ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788359256.810997:0:9979:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788359256.811112:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318912 00000100:00100000:1.0:1788359256.811118:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318912 00000100:00100000:1.0:1788359256.811170:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359256.811179:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9980:x1875230445318912:12345-0@lo:700: 00000100:00100000:1.0:1788359256.811210:0:8440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8440:1875230445319040:0@lo:700: 00000100:00100000:1.0:1788359256.811249:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.811277:0:8440:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5240 going to sleep for 11 seconds 00000100:00080000:0.0:1788359256.811317:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359256.812113:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.812170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319040 00000100:00100000:3.0:1788359256.812177:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319040 00000100:00100000:3.0:1788359256.812248:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359256.812258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8440:x1875230445319040:12345-0@lo:700: 00000100:00100000:2.0:1788359256.812530:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.812597:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445318784 00000100:00100000:0.0:1788359256.812601:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445318784 00000100:00100000:0.0:1788359256.812675:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788359256.812683:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445318784:12345-0@lo:501: 00000100:00100000:0.0:1788359256.812813:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445318784:12345-0@lo:501: Request processed in 130us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.812821:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788359256.813031:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445318784:0@lo:501: 00000100:00100000:3.0:1788359256.813101:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319168:0@lo:503: 00000100:00100000:3.0:1788359256.813143:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.813734:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.813865:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319168 00000100:00100000:2.0:1788359256.813871:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319168 00000100:00100000:2.0:1788359256.813905:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788359256.813913:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445319168:12345-0@lo:503: 00000100:00100000:2.0:1788359256.814093:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445319168:12345-0@lo:503: Request processed in 180us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.814101:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788359256.814193:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319168:0@lo:503: 00000100:00100000:3.0:1788359256.814899:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9981:1875230445319296:0@lo:502: 00000100:00100000:3.0:1788359256.814946:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.814988:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.815097:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319296 00000100:00100000:2.0:1788359256.815103:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319296 00000100:00100000:2.0:1788359256.815140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788359256.815147:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:9981:x1875230445319296:12345-0@lo:502: 00000100:00100000:2.0:1788359256.815247:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:9981:x1875230445319296:12345-0@lo:502: Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.815254:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788359256.815522:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9981:1875230445319296:0@lo:502: 00000100:00100000:3.0:1788359256.815569:0:9981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9981:1875230445319424:0@lo:502: 00000100:00100000:3.0:1788359256.815602:0:9981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.815623:0:9981:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.815681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319424 00000100:00100000:2.0:1788359256.815686:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319424 00000100:00100000:2.0:1788359256.815711:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788359256.815717:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:9981:x1875230445319424:12345-0@lo:502: 00000100:00100000:2.0:1788359256.815792:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:9981:x1875230445319424:12345-0@lo:502: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.815800:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788359256.815889:0:9981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9981:1875230445319424:0@lo:502: 00000040:00080000:3.0:1788359256.815911:0:9981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788359256.816200:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788359256.816223:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359256.816234:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.816246:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.816256:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359256.816258:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eae4e42000 from 6 10000000:01000000:2.0:1788359256.816261:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359256.816362:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.816371:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.816457:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.816490:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319552:0@lo:101: 00000100:00100000:2.0:1788359256.816567:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.816600:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.816659:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319552 00000100:00100000:0.0:1788359256.816664:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319552 00000100:00100000:0.0:1788359256.816702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788359256.816710:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445319552:12345-0@lo:101: 00010000:00010000:0.0:1788359256.816719:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.816732:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a200/0x49dd053b5feae40d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae406 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.816752:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a200/0x49dd053b5feae40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae406 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.816770:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a200/0x49dd053b5feae40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae406 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.816778:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a200, rc 0) 00000100:00100000:0.0:1788359256.816813:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445319552:12345-0@lo:101: Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.816818:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788359256.816914:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319552:0@lo:101: 00010000:00010000:3.0:1788359256.816927:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359256.816937:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359256.817058:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319680:0@lo:256: 00000100:00100000:3.0:1788359256.817089:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.817107:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.817120:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319680 00000100:00100000:3.0:1788359256.817123:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319680 00000100:00100000:3.0:1788359256.817149:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788359256.817154:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445319680:12345-0@lo:256: 20000000:01000000:3.0:1788359256.817168:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788359256.817185:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788359256.817189:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788359256.817779:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319680:0@lo:256: 10000000:01000000:2.0:1788359256.817830:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359256.817838:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.817848:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359256.817856:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788359256.817859:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788359256.817862:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788359256.817882:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.817890:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.817898:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.817911:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319808:0@lo:101: 00000100:00100000:2.0:1788359256.817952:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.818054:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445319680:12345-0@lo:256: Request processed in 110us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.818063:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788359256.818105:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.818154:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319808 00000100:00100000:0.0:1788359256.818159:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319808 00000100:00100000:0.0:1788359256.818182:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788359256.818189:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445319808:12345-0@lo:101: 00010000:00010000:0.0:1788359256.818199:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.818211:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae414 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.818228:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.818238:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.818246:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a800, rc 0) 00000100:00100000:0.0:1788359256.818298:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445319808:12345-0@lo:101: Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.818303:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788359256.818489:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319808:0@lo:101: 00010000:00010000:2.0:1788359256.818535:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.818544:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.818598:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319936:0@lo:501: 00000100:00100000:2.0:1788359256.818624:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.818641:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.818760:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445319936 00000100:00100000:1.0:1788359256.818765:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445319936 00000100:00100000:1.0:1788359256.818834:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788359256.818841:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445319936:12345-0@lo:501: 00000100:00100000:1.0:1788359256.818955:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445319936:12345-0@lo:501: Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.818961:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788359256.819083:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445319936:0@lo:501: 00000100:00100000:2.0:1788359256.819109:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320064:0@lo:503: 00000100:00100000:2.0:1788359256.819152:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.819167:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.819217:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320064 00000100:00100000:1.0:1788359256.819221:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320064 00000100:00100000:1.0:1788359256.819235:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788359256.819240:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445320064:12345-0@lo:503: 00000100:00100000:1.0:1788359256.819332:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445320064:12345-0@lo:503: Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.819338:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788359256.819423:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320064:0@lo:503: 00000100:00100000:2.0:1788359256.819941:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9982:1875230445320192:0@lo:502: 00000100:00100000:2.0:1788359256.819993:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.820022:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.820589:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320192 00000100:00100000:1.0:1788359256.820594:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320192 00000100:00100000:1.0:1788359256.820628:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788359256.820636:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:9982:x1875230445320192:12345-0@lo:502: 00000100:00100000:1.0:1788359256.820724:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:9982:x1875230445320192:12345-0@lo:502: Request processed in 88us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.820731:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000004:00080000:2.0:1788359256.821155:0:7445:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788359256.821203:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9982:1875230445320192:0@lo:502: 00000020:01000000:2.0:1788359256.821228:0:9982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788359256.821237:0:9982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788359256.821245:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359256.821247:0:9982:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788359256.821252:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788359256.821256:0:9982:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:2.0:1788359256.821289:0:9982:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788359256.821299:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359256.821313:0:9982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0eafef7b380) 00000020:00000080:2.0:1788359256.821335:0:9982:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788359256.821341:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788359256.821680:0:9982:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788359256.821687:0:9982:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788359256.821694:0:9982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feae429 00010000:00080000:2.0:1788359256.821723:0:9982:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c7417000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:2.0:1788359256.821951:0:9982:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1788359256.822164:0:9982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788359256.822176:0:9982:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 40000000:02000000:1.0:1788359256.822864:0:6522:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000040:00080000:2.0:1788359256.828461:0:9982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359256.828798:0:9982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359256.830125:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788359256.830245:0:9982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:1.0:1788359256.831770:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8440:x1875230445319040:12345-0@lo:700: Request processed in 19506us (20511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.831784:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788359256.831894:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7394700 x1875230445319040/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.831923:0:8440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8440:1875230445319040:0@lo:700: 40000000:02000000:0.0:1788359256.831937:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:2.0:1788359256.836448:0:9983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359256.836456:0:9983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788359256.837370:0:9982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788359256.837393:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788359256.837430:0:9982:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788359256.837458:0:9982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae430 00000100:00080000:2.0:1788359256.837471:0:9982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788359256.837478:0:9982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0e9c7417000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359256.837555:0:9982:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74bdf80 x1875230445320320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359256.837578:0:9982:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788359256.837630:0:9982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359256.837635:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359256.837637:0:9982:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788359256.837640:0:9982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359256.837650:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359256.837651:0:9982:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788359256.837655:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788359256.837657:0:9982:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788359256.837689:0:9982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9982:1875230445320448:0@lo:502: 00000100:00100000:2.0:1788359256.837775:0:9982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.837814:0:9982:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac5222540 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.838530:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445320320:0@lo:8: 00000100:00100000:3.0:1788359256.838581:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.838776:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320320 00000100:00100000:0.0:1788359256.838784:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320320 00000100:00100000:0.0:1788359256.838829:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359256.838836:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445320320:12345-0@lo:8: 00010000:00080000:0.0:1788359256.838866:0:8431:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1788359256.838953:0:8431:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feae437 00002000:00100000:0.0:1788359256.839062:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0eaff1c6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788359256.839067:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788359256.839070:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788359256.839140:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788359256.839167:0:8431:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1c1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359256.839234:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445320320:12345-0@lo:8: Request processed in 395us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.839241:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359256.839410:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320448 00000100:00100000:1.0:1788359256.839416:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320448 00000100:00100000:1.0:1788359256.839452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788359256.839460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:9982:x1875230445320448:12345-0@lo:502: 00000100:00100000:1.0:1788359256.839614:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:9982:x1875230445320448:12345-0@lo:502: Request processed in 154us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.839621:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788359256.839773:0:9982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:9982:1875230445320448:0@lo:502: 00000020:01000000:2.0:1788359256.839805:0:9982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359256.839812:0:9982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359256.839814:0:9982:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788359256.839819:0:9982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788359256.840778:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788359256.840803:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788359256.840813:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.840825:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359256.840835:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788359256.840838:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0eaf5930000 from 1 10000000:01000000:1.0:1788359256.840841:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788359256.840891:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.840900:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359256.840909:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359256.840930:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320576:0@lo:101: 00000100:00100000:1.0:1788359256.840991:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359256.841024:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.841207:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320576 00000100:00100000:0.0:1788359256.841214:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320576 00000100:00100000:0.0:1788359256.841258:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788359256.841276:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445320576:12345-0@lo:101: 00010000:00010000:0.0:1788359256.841292:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359256.841307:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae43e expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.841330:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae43e expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.841352:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae43e expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359256.841362:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14aa00, rc 0) 00000100:00100000:0.0:1788359256.841425:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445320576:12345-0@lo:101: Request processed in 150us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.841432:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788359256.841857:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320576:0@lo:101: 00010000:00010000:2.0:1788359256.841873:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.841892:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359256.841952:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320704:0@lo:501: 00000100:00100000:2.0:1788359256.841996:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359256.842015:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.842195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320704 00000100:00100000:0.0:1788359256.842200:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320704 00000100:00100000:0.0:1788359256.842234:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788359256.842242:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445320704:12345-0@lo:501: 00000100:00100000:0.0:1788359256.842326:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445320704:12345-0@lo:501: Request processed in 85us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359256.842333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788359256.842553:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445320704:0@lo:501: 10000000:01000000:2.0:1788359256.842580:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788359256.842586:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359256.842595:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788359256.842723:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788359256.842838:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445318912:12345-0@lo:700: Request processed in 31660us (32011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.842850:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788359256.842991:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead2753480 x1875230445318912/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.843002:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445318912:0@lo:700: 00010000:00080000:3.0:1788359256.843618:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bdf80 x1875230445320320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.843628:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359256.843635:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788359256.843643:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788359256.843648:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788359256.843652:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7417000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788359256.843715:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788359256.843723:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445320320:0@lo:8: 00000004:00080000:2.0:1788359256.843870:0:9983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788359256.843936:0:9983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288814440576ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788359256.843942:0:9983:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788359256.847733:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788359256.852954:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1788359256.853115:0:9980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788359256.853150:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445320960:0@lo:7: 00000100:00100000:0.0:1788359256.853219:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.853256:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc529600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.853329:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320960 00000100:00100000:2.0:1788359256.853337:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320960 00000100:00100000:2.0:1788359256.853403:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359256.853413:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445320960:12345-0@lo:7: 00000004:00080000:3.0:1788359256.855864:0:9984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788359256.855908:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321216:0@lo:7: 00000100:00100000:3.0:1788359256.855987:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.856027:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321216 00000100:00100000:3.0:1788359256.856034:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321216 00000100:00100000:3.0:1788359256.856088:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359256.856096:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9984:x1875230445321216:12345-0@lo:7: 00000100:00080000:3.0:1788359256.856147:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359256.856173:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.856362:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359256.856374:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445321088:0@lo:13: 00000100:00100000:2.0:1788359256.856425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.856491:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321088 00000100:00100000:3.0:1788359256.856527:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321088 00000100:00100000:3.0:1788359256.856558:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788359256.856566:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445321088:12345-0@lo:13: 00002000:00000024:3.0:1788359256.856586:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788359256.856635:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445321088:12345-0@lo:13: Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.856642:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788359256.856684:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaece0df80 x1875230445321088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.856704:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445321088:0@lo:13: 00000100:00100000:1.0:1788359256.859654:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445320832:0@lo:13: 00000100:00100000:1.0:1788359256.859728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.864065:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445320832 00000100:00100000:3.0:1788359256.864077:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445320832 00000100:00100000:3.0:1788359256.864128:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359256.864136:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445320832:12345-0@lo:13: 00002000:00000024:3.0:1788359256.864172:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788359256.864243:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445320832:12345-0@lo:13: Request processed in 108us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359256.864249:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788359256.864312:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61be680 x1875230445320832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.864331:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445320832:0@lo:13: 00002000:00080000:0.0:1788359256.864543:0:8882:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788359256.864549:0:8882:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788359256.864589:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445320960:12345-0@lo:7: Request processed in 11178us (11369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359256.864601:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788359256.864704:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61bdf80 x1875230445320960/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.864714:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445320960:0@lo:7: 00000004:00080000:3.0:1788359256.864731:0:9980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788359256.864763:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445321344:0@lo:5: 00000100:00100000:3.0:1788359256.864796:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.864826:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359256.864868:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321344 00000100:00100000:2.0:1788359256.864873:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321344 00000100:00100000:2.0:1788359256.864917:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359256.864925:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445321344:12345-0@lo:5: 00002000:00080000:2.0:1788359256.864945:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788359256.864989:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445321344:12345-0@lo:5: Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.864994:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788359256.865096:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27b9c00 x1875230445321344/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.865105:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445321344:0@lo:5: 00000004:00080000:0.0:1788359256.865112:0:9980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788359256.865133:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445321472:0@lo:5: 00000100:00100000:0.0:1788359256.865153:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.865175:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc529f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359256.865211:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321472 00000100:00100000:3.0:1788359256.865215:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321472 00000100:00100000:3.0:1788359256.865242:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788359256.865248:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9980:x1875230445321472:12345-0@lo:5: 00002000:00080000:3.0:1788359256.865275:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788359256.867426:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9980:x1875230445321472:12345-0@lo:5: Request processed in 2172us (2266us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788359256.867438:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788359256.868664:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61bf480 x1875230445321472/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.868685:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9980:1875230445321472:0@lo:5: 00000004:00080000:0.0:1788359256.868711:0:9980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788359256.868752:0:9980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9980:1875230445321600:0@lo:900: 00000100:00100000:0.0:1788359256.868797:0:9980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359256.868833:0:9980:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc529f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.868966:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321600 00000100:00100000:1.0:1788359256.868974:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321600 00000100:00100000:1.0:1788359256.869026:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359256.869036:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9980:x1875230445321600:12345-0@lo:900: 00002000:00080000:2.0:1788359256.870168:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788359256.870174:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788359256.870254:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9984:x1875230445321216:12345-0@lo:7: Request processed in 14158us (14266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.870276:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359256.870349:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9980:x1875230445321600:12345-0@lo:900: Request processed in 1315us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359256.870356:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788359256.870533:0:9980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61bea00 x1875230445321600/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359256.870546:0:9980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9980:1875230445321600:0@lo:900: 00010000:00080000:3.0:1788359256.870720:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bb100 x1875230445321216/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.870730:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321216:0@lo:7: 00000004:00080000:3.0:1788359256.870740:0:9984:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788359256.870769:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321728:0@lo:5: 00000100:00100000:3.0:1788359256.870799:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.870855:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.870936:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321728 00000100:00100000:0.0:1788359256.870941:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321728 00000100:00100000:0.0:1788359256.870994:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359256.871000:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9984:x1875230445321728:12345-0@lo:5: 00002000:00080000:0.0:1788359256.871019:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788359256.871027:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:0.0:1788359256.873996:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:0.0:1788359256.874011:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788359256.874017:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788359256.874143:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9984:x1875230445321728:12345-0@lo:5: Request processed in 3137us (3338us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788359256.874160:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788359256.874173:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bb100 x1875230445321728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.874183:0:9984:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788359256.874189:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321728:0@lo:5: 00000004:00080000:3.0:1788359256.874204:0:9984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788359256.874246:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321856:0@lo:700: 00000100:00100000:3.0:1788359256.874350:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.874436:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:1.0:1788359256.874472:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321856 00000100:00100000:1.0:1788359256.874479:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321856 00000100:00100000:1.0:1788359256.874583:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359256.874592:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9984:x1875230445321856:12345-0@lo:700: 00000100:00100000:2.0:1788359256.885937:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9984:x1875230445321856:12345-0@lo:700: Request processed in 11335us (11576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359256.885953:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788359256.886444:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bb100 x1875230445321856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.886457:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321856:0@lo:700: 00000004:02000040:3.0:1788359256.887919:0:9984:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788359256.892256:0:9984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321984:0@lo:5: 00000100:00100000:3.0:1788359256.892331:0:9984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359256.892451:0:9984:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359256.892901:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445321984 00000100:00100000:0.0:1788359256.892910:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445321984 00000100:00100000:0.0:1788359256.893003:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359256.893014:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9984:x1875230445321984:12345-0@lo:5: 00002000:00080000:0.0:1788359256.897200:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788359256.897220:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788359256.898360:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9984:x1875230445321984:12345-0@lo:5: Request processed in 5344us (6025us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788359256.898368:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788359256.898489:0:9984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bb100 x1875230445321984/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359272 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359256.898531:0:9984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9984:1875230445321984:0@lo:5: 00000004:00080000:3.0:1788359256.898547:0:9984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788359257.470018:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788359257.537138:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000020:00000004:0.0:1788359258.367548:0:10034:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359258.367922:0:10034:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359258.502879:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359259.325730:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445322112:0@lo:41: 00000100:00100000:0.0:1788359259.325839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359259.326080:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322112 00000100:00100000:2.0:1788359259.326093:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322112 00000100:00100000:2.0:1788359259.326150:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788359259.326159:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445322112:12345-0@lo:41: 00000004:00000024:2.0:1788359259.326208:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359259.326279:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445322112:12345-0@lo:41: Request processed in 121us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359259.326286:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788359259.326347:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445322112:0@lo:41: 00000020:00000004:0.0:1788359259.338135:0:10083:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359259.338150:0:10083:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788359259.518017:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359259.833349:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359259.833738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420107392 00000100:00100000:0.0:1788359259.833753:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420107392 00000100:00100000:0.0:1788359259.833815:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:0.0:1788359259.833827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1875230420107392:12345-192.168.202.52@tcp:250: 00010000:00080000:0.0:1788359259.833867:0:6510:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 51c1d10b-f267-4ee9-bf88-d15c1428dfcb@192.168.202.52@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:0.0:1788359259.833905:0:6510:0:(genops.c:1406:class_connect()) connect: client 51c1d10b-f267-4ee9-bf88-d15c1428dfcb, cookie 0x49dd053b5feae44c 00000100:00080000:0.0:1788359259.834046:0:6510:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359259.834139:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+5:2401:x1875230420107392:12345-192.168.202.52@tcp:250: Request processed in 312us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359259.834166:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:0.0:1788359259.836775:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359259.836805:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445322240:0@lo:41: 00000100:00100000:0.0:1788359259.836879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359259.836994:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322240 00000100:00100000:2.0:1788359259.837003:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322240 00000100:00100000:2.0:1788359259.837053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788359259.837062:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445322240:12345-0@lo:41: 00000004:00000024:2.0:1788359259.837119:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788359259.837180:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445322240:12345-0@lo:41: Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359259.837188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788359259.837406:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445322240:0@lo:41: 00000100:00100000:2.0:1788359259.841478:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.841628:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420107520 00000100:00100000:1.0:1788359259.841640:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420107520 00000100:00100000:1.0:1788359259.841803:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00100000:1.0:1788359259.841814:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+5:6161:x1875230420107520:12345-192.168.202.52@tcp:101: 00010000:00010000:1.0:1788359259.841835:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359259.841857:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6cfc expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359259.841898:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359259.841912:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359259.841922:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057e00, rc 0) 00000100:00100000:1.0:1788359259.842000:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+6:6161:x1875230420107520:12345-192.168.202.52@tcp:101: Request processed in 189us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359259.842006:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00100000:3.0:1788359259.846192:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.846543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420107648 00000100:00100000:1.0:1788359259.846556:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420107648 00000100:00100000:1.0:1788359259.846652:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 181 00000100:00100000:1.0:1788359259.846663:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+6:6161:x1875230420107648:12345-192.168.202.52@tcp:501: 00000100:00100000:1.0:1788359259.847570:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+6:6161:x1875230420107648:12345-192.168.202.52@tcp:501: Request processed in 902us (1384us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788359259.847583:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 181 00000100:00100000:2.0:1788359259.865856:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359259.866039:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420107776 00000100:00100000:0.0:1788359259.866053:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420107776 00000100:00100000:0.0:1788359259.866186:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 182 00000100:00100000:0.0:1788359259.866198:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+6:6161:x1875230420107776:12345-192.168.202.52@tcp:101: 00010000:00010000:0.0:1788359259.866221:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359259.866246:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d03 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359259.866286:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359259.866299:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359259.866325:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b200, rc 0) 00000100:00100000:0.0:1788359259.866417:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+7:6161:x1875230420107776:12345-192.168.202.52@tcp:101: Request processed in 222us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359259.866427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 182 00000100:00100000:2.0:1788359259.870755:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.872423:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420107904 00000100:00100000:1.0:1788359259.872446:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420107904 00000100:00100000:1.0:1788359259.872589:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 183 00000100:00100000:1.0:1788359259.872602:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+7:6161:x1875230420107904:12345-192.168.202.52@tcp:501: 00000100:00100000:1.0:1788359259.872873:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6161:x1875230420107904:12345-192.168.202.52@tcp:501: Request processed in 273us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359259.872882:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 183 00000100:00100000:3.0:1788359259.885052:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359259.885236:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108032 00000100:00100000:0.0:1788359259.885251:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108032 00000100:00100000:0.0:1788359259.885333:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 184 00000100:00100000:0.0:1788359259.885346:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6161:x1875230420108032:12345-192.168.202.52@tcp:503: 00000100:00100000:0.0:1788359259.885616:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6161:x1875230420108032:12345-192.168.202.52@tcp:503: Request processed in 271us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359259.885632:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 184 00000100:00100000:2.0:1788359259.896715:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359259.896860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108160 00000100:00100000:0.0:1788359259.896875:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108160 00000100:00100000:0.0:1788359259.896957:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 185 00000100:00100000:0.0:1788359259.896969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6180:x1875230420108160:12345-192.168.202.52@tcp:502: 00000100:00100000:0.0:1788359259.897249:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6180:x1875230420108160:12345-192.168.202.52@tcp:502: Request processed in 281us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359259.897258:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 185 00000100:00100000:2.0:1788359259.935030:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.935204:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108288 00000100:00100000:1.0:1788359259.935219:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108288 00000100:00100000:1.0:1788359259.935296:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 186 00000100:00100000:1.0:1788359259.935318:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6180:x1875230420108288:12345-192.168.202.52@tcp:502: 00000100:00100000:1.0:1788359259.935580:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6180:x1875230420108288:12345-192.168.202.52@tcp:502: Request processed in 273us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359259.935589:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 186 00000100:00100000:3.0:1788359259.953201:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359259.956011:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108416 00000100:00100000:2.0:1788359259.956033:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108416 00000100:00100000:2.0:1788359259.956138:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:2.0:1788359259.956151:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6161:x1875230420108416:12345-192.168.202.52@tcp:101: 00010000:00010000:2.0:1788359259.956176:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359259.956204:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d34 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.956246:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d34 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.956260:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d34 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.956271:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40400, rc 0) 00000100:00100000:2.0:1788359259.958926:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6161:x1875230420108416:12345-192.168.202.52@tcp:101: Request processed in 2754us (5716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359259.958947:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:2.0:1788359259.966631:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359259.966738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108544 00000100:00100000:0.0:1788359259.966753:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108544 00000100:00100000:0.0:1788359259.966827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:0.0:1788359259.966839:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6161:x1875230420108544:12345-192.168.202.52@tcp:256: 20000000:01000000:0.0:1788359259.966885:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788359259.966925:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788359259.966929:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788359259.966933:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788359259.966936:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788359259.966939:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788359259.975536:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6161:x1875230420108544:12345-192.168.202.52@tcp:256: Request processed in 8647us (8878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359259.975557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:3.0:1788359259.980029:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359259.980135:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108672 00000100:00100000:2.0:1788359259.980148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108672 00000100:00100000:2.0:1788359259.980278:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:2.0:1788359259.980290:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6161:x1875230420108672:12345-192.168.202.52@tcp:101: 00010000:00010000:2.0:1788359259.980323:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359259.980347:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d3b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.980396:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.980434:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359259.980446:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40c00, rc 0) 00000100:00100000:2.0:1788359259.980566:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6161:x1875230420108672:12345-192.168.202.52@tcp:101: Request processed in 275us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359259.980573:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:0.0:1788359259.983559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.983716:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108800 00000100:00100000:1.0:1788359259.983729:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108800 00000100:00100000:1.0:1788359259.983823:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00100000:1.0:1788359259.983835:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6161:x1875230420108800:12345-192.168.202.52@tcp:501: 00000100:00100000:1.0:1788359259.984211:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6161:x1875230420108800:12345-192.168.202.52@tcp:501: Request processed in 378us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359259.984221:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00100000:3.0:1788359259.986813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359259.986945:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420108928 00000100:00100000:2.0:1788359259.986961:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420108928 00000100:00100000:2.0:1788359259.987079:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 191 00000100:00100000:2.0:1788359259.987092:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6161:x1875230420108928:12345-192.168.202.52@tcp:503: 00000100:00100000:2.0:1788359259.987323:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6161:x1875230420108928:12345-192.168.202.52@tcp:503: Request processed in 232us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359259.987332:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 191 00000100:00100000:3.0:1788359259.992938:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359259.993175:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109056 00000100:00100000:1.0:1788359259.993191:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109056 00000100:00100000:1.0:1788359259.993260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 192 00000100:00100000:1.0:1788359259.993271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6186:x1875230420109056:12345-192.168.202.52@tcp:502: 00000100:00100000:1.0:1788359259.993674:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6186:x1875230420109056:12345-192.168.202.52@tcp:502: Request processed in 404us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359259.993683:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 192 00000100:00100000:0.0:1788359260.003978:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359260.004106:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109184 00000100:00100000:2.0:1788359260.004122:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109184 00000100:00100000:2.0:1788359260.004201:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 193 00000100:00100000:2.0:1788359260.004216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6186:x1875230420109184:12345-192.168.202.52@tcp:502: 00000100:00100000:2.0:1788359260.006578:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6186:x1875230420109184:12345-192.168.202.52@tcp:502: Request processed in 2348us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359260.006597:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 193 00000100:00100000:0.0:1788359260.012196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359260.012786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359260.012879:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109312 00000100:00100000:1.0:1788359260.012899:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109312 00000100:00100000:1.0:1788359260.012952:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109568 00000100:00100000:1.0:1788359260.012955:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109568 00000100:00100000:1.0:1788359260.012987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359260.012996:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875230420109312:12345-192.168.202.52@tcp:38: 00010000:00080000:1.0:1788359260.013036:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:1.0:1788359260.013107:0:6516:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae46f 00000004:00100000:1.0:1788359260.013140:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788359260.013434:0:6516:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7459800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359260.013543:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420109312:12345-192.168.202.52@tcp:38: Request processed in 546us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359260.013550:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359260.013570:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:1.0:1788359260.013584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875230420109568:12345-192.168.202.52@tcp:38: 00010000:00080000:1.0:1788359260.013601:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:1.0:1788359260.013635:0:6516:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae476 00000004:00100000:1.0:1788359260.013651:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788359260.013792:0:6516:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7459000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359260.013818:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420109568:12345-192.168.202.52@tcp:38: Request processed in 233us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359260.013825:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00010000:00010000:0.0:1788359260.547038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359261.024484:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359261.024593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359261.024625:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359261.024684:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109696 00000100:00100000:3.0:1788359261.024699:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109696 00000100:00100000:2.0:1788359261.024805:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109440 00000100:00100000:2.0:1788359261.024811:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109440 00000100:00100000:2.0:1788359261.024853:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109824 00000100:00100000:2.0:1788359261.024856:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109824 00000100:00100000:2.0:1788359261.024876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:2.0:1788359261.024903:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:0:x1875230420109440:12345-192.168.202.52@tcp:41: 00000100:00100000:3.0:1788359261.024904:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:3.0:1788359261.024912:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:6161:x1875230420109824:12345-192.168.202.52@tcp:41: 00000004:00000024:3.0:1788359261.024955:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:2.0:1788359261.024955:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788359261.025048:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:0:x1875230420109440:12345-192.168.202.52@tcp:41: Request processed in 153us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359261.025057:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:2.0:1788359261.025079:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:2.0:1788359261.025086:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:0:x1875230420109696:12345-192.168.202.52@tcp:41: 00000004:00000024:2.0:1788359261.025104:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359261.025116:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420109824:12345-192.168.202.52@tcp:41: Request processed in 205us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.025123:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359261.025124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:0:x1875230420109696:12345-192.168.202.52@tcp:41: Request processed in 40us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359261.025130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00080000:0.0:1788359261.025249:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359261.025252:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359261.038477:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359261.038606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420109952 00000100:00100000:3.0:1788359261.038621:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420109952 00000100:00100000:3.0:1788359261.038704:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:3.0:1788359261.038715:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420109952:12345-192.168.202.52@tcp:40: 00000100:00100000:3.0:1788359261.038837:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420109952:12345-192.168.202.52@tcp:40: Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.038855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359261.050813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359261.050878:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359261.050917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359261.051239:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110080 00000100:00100000:2.0:1788359261.051253:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110080 00000100:00100000:2.0:1788359261.051311:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110208 00000100:00100000:2.0:1788359261.051314:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110208 00000100:00100000:2.0:1788359261.051337:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:2.0:1788359261.051358:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1875230420110080:12345-192.168.202.52@tcp:8: 00010000:00080000:2.0:1788359261.051405:0:8882:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1788359261.051447:0:8882:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae47d 00002000:00100000:2.0:1788359261.051464:0:8882:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10b7ecde-1562-4877-be1f-e5861af40d5e/ffffa0e9c7413800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788359261.051490:0:8882:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788359261.051776:0:8882:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788359261.051818:0:8882:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7416000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359261.054613:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:1.0:1788359261.054631:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420110208:12345-192.168.202.52@tcp:8: 00010000:00080000:1.0:1788359261.054681:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:1.0:1788359261.054724:0:8430:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae484 00002000:00100000:1.0:1788359261.054741:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10b7ecde-1562-4877-be1f-e5861af40d5e/ffffa0e9c745a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788359261.054763:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788359261.055534:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788359261.055578:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c745d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359261.055672:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420110208:12345-192.168.202.52@tcp:8: Request processed in 1043us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.055681:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:2.0:1788359261.056664:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420110080:12345-192.168.202.52@tcp:8: Request processed in 5298us (5860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359261.056697:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:3.0:1788359261.057047:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110336 00000100:00100000:3.0:1788359261.057059:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110336 00000100:00100000:1.0:1788359261.057129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359261.057142:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:3.0:1788359261.057155:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420110336:12345-192.168.202.52@tcp:900: 00000100:00100000:1.0:1788359261.057188:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110464 00000100:00100000:1.0:1788359261.057193:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110464 00000100:00100000:1.0:1788359261.057229:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 194 00000100:00100000:3.0:1788359261.057237:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420110336:12345-192.168.202.52@tcp:900: Request processed in 84us (6355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.057238:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420110464:12345-192.168.202.52@tcp:400: 00000100:00100000:3.0:1788359261.057254:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:1.0:1788359261.057274:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420110464:12345-192.168.202.52@tcp:400: Request processed in 38us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.057289:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 194 00000100:00100000:1.0:1788359261.063218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359261.063391:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110592 00000100:00100000:2.0:1788359261.063416:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110592 00000100:00100000:2.0:1788359261.063489:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:2.0:1788359261.063559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420110592:12345-192.168.202.52@tcp:33: 00000004:00080000:3.0:1788359261.087160:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23478us 00000004:00200000:2.0:1788359261.138252:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788359261.143163:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6161:x1875230420110592:12345-192.168.202.52@tcp:33: Request processed in 79589us (79943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.143221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:3.0:1788359261.394620:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359261.394780:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110720 00000100:00100000:2.0:1788359261.394798:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110720 00000100:00100000:2.0:1788359261.394892:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:2.0:1788359261.394903:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6204:x1875230420110720:12345-192.168.202.52@tcp:101: 00010000:00010000:2.0:1788359261.394928:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359261.395084:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41400/0x49dd053b5feae48b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d6c expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395170:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395183:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395198:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359261.395244:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788359261.395249:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359261.395267:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395294:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41400/0x49dd053b5feae48b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d6c expref: 8 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395349:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d6c expref: 7 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359261.395358:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eb020dd000) 00010000:00010000:2.0:1788359261.395361:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359261.395365:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41800, rc 0) 00000100:00100000:2.0:1788359261.395540:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:6204:x1875230420110720:12345-192.168.202.52@tcp:101: Request processed in 639us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359261.395547:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00010000:00010000:3.0:1788359261.564712:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359261.884821:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445322752:0@lo:400: 00000100:00100000:1.0:1788359261.884891:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.884961:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445323264:0@lo:400: 00000100:00100000:1.0:1788359261.884987:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885010:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445323776:0@lo:400: 00000100:00100000:1.0:1788359261.885029:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885052:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788359261.885058:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445322624:0@lo:400: 00000100:00100000:1.0:1788359261.885078:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885094:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445323136:0@lo:400: 00000100:00100000:1.0:1788359261.885111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885124:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445323648:0@lo:400: 00000100:00100000:1.0:1788359261.885141:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885168:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323264 00000100:00100000:1.0:1788359261.885176:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323264 00000100:00100000:1.0:1788359261.885222:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323776 00000100:00100000:1.0:1788359261.885225:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323776 00000100:00100000:1.0:1788359261.885244:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359261.885253:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445323264:12345-0@lo:400: 00000100:00100000:3.0:1788359261.885533:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445322496:0@lo:400: 00000100:00100000:3.0:1788359261.885576:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359261.885619:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445323008:0@lo:400: 00000100:00100000:3.0:1788359261.885641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359261.885655:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445323520:0@lo:400: 00000100:00100000:1.0:1788359261.885684:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445323264:12345-0@lo:400: Request processed in 431us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.885692:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359261.885709:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359261.885716:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445323776:12345-0@lo:400: 00000100:00100000:1.0:1788359261.885752:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445323776:12345-0@lo:400: Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.885758:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788359261.885770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885782:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322624 00000100:00100000:1.0:1788359261.885787:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322624 00000100:00100000:3.0:1788359261.885790:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445324032:0@lo:13: 00000100:00100000:1.0:1788359261.885818:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359261.885819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.885830:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445322624:12345-0@lo:400: 00000100:00100000:1.0:1788359261.885863:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445322624:12345-0@lo:400: Request processed in 36us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.885869:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788359261.885902:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445322624:0@lo:400: 00010000:00080000:1.0:1788359261.885916:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7394700 x1875230445323264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359261.885927:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445323264:0@lo:400: 00000100:00100000:3.0:1788359261.885974:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788359261.885983:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445322368:0@lo:400: 00000100:00100000:3.0:1788359261.886014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359261.886039:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445322880:0@lo:400: 00010000:00080000:1.0:1788359261.886052:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cb3100 x1875230445323776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359261.886062:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788359261.886078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.886079:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445323776:0@lo:400: 00000100:00100000:3.0:1788359261.886102:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445323392:0@lo:400: 00000100:00100000:1.0:1788359261.886117:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322752 00000100:00100000:1.0:1788359261.886122:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322752 00000100:00100000:3.0:1788359261.886128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.886146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323136 00000100:00100000:1.0:1788359261.886150:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323136 00000100:00100000:3.0:1788359261.886154:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445323904:0@lo:400: 00000100:00100000:1.0:1788359261.886168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323648 00000100:00100000:1.0:1788359261.886172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323648 00000100:00100000:3.0:1788359261.886177:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.886187:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322496 00000100:00100000:1.0:1788359261.886191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322496 00000100:00100000:1.0:1788359261.886206:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323008 00000100:00100000:1.0:1788359261.886213:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323008 00000100:00100000:3.0:1788359261.886238:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323520 00000100:00100000:3.0:1788359261.886243:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323520 00000100:00100000:1.0:1788359261.886245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788359261.886257:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445322752:12345-0@lo:400: 00000100:00100000:3.0:1788359261.886276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359261.886286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445323136:12345-0@lo:400: 00000100:00100000:2.0:1788359261.886406:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788359261.886416:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788359261.886433:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322880 00000100:00100000:2.0:1788359261.886437:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322880 00000100:00100000:1.0:1788359261.886836:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445322752:12345-0@lo:400: Request processed in 582us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.886843:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788359261.886858:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788359261.886865:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445323648:12345-0@lo:400: 00000100:00100000:3.0:1788359261.887545:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445323136:12345-0@lo:400: Request processed in 1254us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.887555:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359261.887576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788359261.887585:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445322496:12345-0@lo:400: 00000100:00100000:2.0:1788359261.887648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788359261.887661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445322880:12345-0@lo:400: 00000100:00100000:3.0:1788359261.887990:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445322496:12345-0@lo:400: Request processed in 407us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.887997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788359261.888014:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788359261.888021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445323008:12345-0@lo:400: 00000100:00100000:0.0:1788359261.888201:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323392 00000100:00100000:0.0:1788359261.888209:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323392 00000100:00100000:0.0:1788359261.888247:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445323904 00000100:00100000:0.0:1788359261.888251:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445323904 00000100:00100000:0.0:1788359261.888268:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359261.888275:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445323392:12345-0@lo:400: 00000100:00100000:2.0:1788359261.892178:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445322880:12345-0@lo:400: Request processed in 4508us (6087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359261.892194:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788359261.893090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445323648:12345-0@lo:400: Request processed in 6219us (7941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.893103:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788359261.893134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788359261.893152:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445323520:12345-0@lo:400: 00000100:00100000:1.0:1788359261.893256:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445323520:12345-0@lo:400: Request processed in 114us (7488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.893262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788359261.893481:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445323008:12345-0@lo:400: Request processed in 5458us (7836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.893491:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788359261.893532:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7394380 x1875230445323136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359261.893534:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324032 00000100:00100000:3.0:1788359261.893542:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324032 00000100:00100000:1.0:1788359261.893551:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445323136:0@lo:400: 00000100:00100000:3.0:1788359261.893594:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359261.893601:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445324032:12345-0@lo:13: 00002000:00000024:3.0:1788359261.893622:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359261.893655:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445324032:12345-0@lo:13: Request processed in 55us (7838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.893672:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359261.893693:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359261.893701:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445323904:12345-0@lo:400: 00000100:00100000:3.0:1788359261.893728:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445323904:12345-0@lo:400: Request processed in 28us (7552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359261.893734:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359261.893762:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445322880:0@lo:400: 00010000:00080000:1.0:1788359261.893807:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cb2680 x1875230445323648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359261.893818:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445323648:0@lo:400: 00000100:00100000:1.0:1788359261.893832:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445322752:0@lo:400: 00000100:00100000:1.0:1788359261.893859:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359261.893873:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324160:0@lo:13: 00000100:00100000:1.0:1788359261.893917:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788359261.894267:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359261.894274:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359261.894277:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359261.894280:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359261.894879:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324160 00000100:00100000:1.0:1788359261.894885:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324160 00000100:00100000:1.0:1788359261.895691:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788359261.895707:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324160:12345-0@lo:13: 00002000:00000024:1.0:1788359261.895730:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359261.895790:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324160:12345-0@lo:13: Request processed in 89us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.895798:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788359261.895839:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c7100 x1875230445324160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359261.895857:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324160:0@lo:13: 00000100:00100000:1.0:1788359261.895883:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445322368 00000100:00100000:1.0:1788359261.895888:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445322368 00000100:00100000:1.0:1788359261.895915:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788359261.896270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445324416:0@lo:13: 00000100:00100000:0.0:1788359261.896540:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445323392:12345-0@lo:400: Request processed in 8264us (10411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359261.896550:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359261.896661:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324288:0@lo:13: 00000100:00100000:0.0:1788359261.896696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359261.896732:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324288 00000100:00100000:0.0:1788359261.896737:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324288 00000100:00100000:0.0:1788359261.896769:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359261.896776:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324288:12345-0@lo:13: 00002000:00000024:0.0:1788359261.896790:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359261.896822:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324288:12345-0@lo:13: Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359261.896828:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788359261.896865:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bf480 x1875230445324288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359261.896879:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324288:0@lo:13: 00000100:00100000:1.0:1788359261.897536:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445322368:12345-0@lo:400: 00000100:00100000:1.0:1788359261.897987:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445322368:12345-0@lo:400: Request processed in 459us (11971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.897995:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:3.0:1788359261.899048:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c55a5500 x1875230445323392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359261.899067:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445323392:0@lo:400: 00010000:00080000:3.0:1788359261.899102:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cb2d80 x1875230445323904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359261.899111:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788359261.899129:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445323904:0@lo:400: 00000100:00100000:3.0:1788359261.899149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445322496:0@lo:400: 00000100:00100000:3.0:1788359261.899163:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445323008:0@lo:400: 00000100:00100000:3.0:1788359261.899175:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445323520:0@lo:400: 00010000:00080000:3.0:1788359261.899187:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6caf800 x1875230445324032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359261.899206:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445324032:0@lo:13: 00000100:00100000:3.0:1788359261.899245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445322368:0@lo:400: 00000100:00100000:0.0:1788359261.904744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359261.905040:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324416 00000100:00100000:1.0:1788359261.905051:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324416 00000100:00100000:1.0:1788359261.905109:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788359261.905120:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445324416:12345-0@lo:13: 00002000:00000024:1.0:1788359261.905151:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359261.905211:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445324416:12345-0@lo:13: Request processed in 93us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359261.905219:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788359261.905860:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bca80 x1875230445324416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359261.905884:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445324416:0@lo:13: 00010000:00010000:0.0:1788359262.589053:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359263.612693:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359263.777298:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359263.777430:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110848 00000100:00100000:2.0:1788359263.777441:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110848 00000100:00100000:2.0:1788359263.777553:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:2.0:1788359263.777566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:6257:x1875230420110848:12345-192.168.202.52@tcp:41: 00000004:00000024:2.0:1788359263.777605:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788359263.777671:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:6257:x1875230420110848:12345-192.168.202.52@tcp:41: Request processed in 109us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359263.777679:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00080000:0.0:1788359263.777748:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359263.782709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359263.782919:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420110976 00000100:00100000:2.0:1788359263.782936:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420110976 00000100:00100000:2.0:1788359263.783103:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:2.0:1788359263.783118:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420110976:12345-192.168.202.52@tcp:41: 00000004:00000024:2.0:1788359263.783431:0:7748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359263.783635:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420110976:12345-192.168.202.52@tcp:41: Request processed in 520us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359263.783644:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00080000:0.0:1788359263.785076:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359263.795119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359263.797204:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111104 00000100:00100000:0.0:1788359263.797230:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111104 00000100:00100000:0.0:1788359263.797525:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:0.0:1788359263.797538:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420111104:12345-192.168.202.52@tcp:13: 00002000:00000024:0.0:1788359263.797584:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359263.797684:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420111104:12345-192.168.202.52@tcp:13: Request processed in 148us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359263.797692:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00080000:2.0:1788359263.801735:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359263.803670:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359263.804074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111232 00000100:00100000:0.0:1788359263.804089:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111232 00000100:00100000:0.0:1788359263.804187:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:0.0:1788359263.804198:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420111232:12345-192.168.202.52@tcp:13: 00002000:00000024:0.0:1788359263.804242:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359263.804356:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10b7ecde-1562-4877-be1f-e5861af40d5e+6:6257:x1875230420111232:12345-192.168.202.52@tcp:13: Request processed in 160us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359263.804364:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00080000:2.0:1788359263.805088:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359264.451019:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445324544:0@lo:41: 00000100:00100000:0.0:1788359264.451140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359264.451521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324544 00000100:00100000:2.0:1788359264.451533:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324544 00000100:00100000:1.0:1788359264.451694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788359264.451711:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445324544:12345-0@lo:41: 00000004:00000024:1.0:1788359264.451769:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359264.451859:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445324544:12345-0@lo:41: Request processed in 154us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359264.451868:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788359264.452071:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445324544:0@lo:41: 00010000:00010000:1.0:1788359264.642701:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359264.957939:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359264.957977:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324672:0@lo:41: 00000100:00100000:3.0:1788359264.958068:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359264.958184:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324672 00000100:00100000:2.0:1788359264.958194:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324672 00000100:00100000:2.0:1788359264.958263:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788359264.958273:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324672:12345-0@lo:41: 00000004:00000024:2.0:1788359264.958333:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788359264.958407:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445324672:12345-0@lo:41: Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359264.958430:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788359264.958519:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445324672:0@lo:41: 00000001:00100000:0.0:1788359264.972744:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00010000:00010000:3.0:1788359265.661893:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788359265.982467:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000001:00100000:2.0:1788359265.993906:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000100:00100000:1.0:1788359266.236085:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359266.236152:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359266.236196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359266.236221:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111616 00000100:00100000:1.0:1788359266.236221:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359266.236239:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111616 00000100:00100000:1.0:1788359266.236254:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359266.236281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111488 00000100:00100000:1.0:1788359266.236287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111488 00000100:00100000:3.0:1788359266.236368:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111360 00000100:00100000:3.0:1788359266.236374:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111360 00000100:00100000:3.0:1788359266.236418:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 196 00000100:00100000:3.0:1788359266.236431:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420111360:12345-192.168.202.52@tcp:400: 00000100:00100000:2.0:1788359266.236443:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:2.0:1788359266.236455:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420111616:12345-192.168.202.52@tcp:400: 00000100:00100000:2.0:1788359266.236956:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420111616:12345-192.168.202.52@tcp:400: Request processed in 501us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359266.236969:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:0.0:1788359266.237040:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111872 00000100:00100000:0.0:1788359266.237047:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111872 00000100:00080000:2.0:1788359266.241545:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359266.241564:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359266.241569:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359266.243133:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420111744 00000100:00100000:0.0:1788359266.243152:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420111744 00000100:00100000:0.0:1788359266.243205:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359266.243218:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420111872:12345-192.168.202.52@tcp:400: 00000100:00100000:3.0:1788359266.243484:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420111360:12345-192.168.202.52@tcp:400: Request processed in 7052us (7410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359266.243522:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 196 00000100:00100000:3.0:1788359266.243591:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:3.0:1788359266.243600:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420111744:12345-192.168.202.52@tcp:400: 00000100:00100000:3.0:1788359266.243636:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420111744:12345-192.168.202.52@tcp:400: Request processed in 37us (7381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359266.243643:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:1.0:1788359266.249525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:1.0:1788359266.249551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420111488:12345-192.168.202.52@tcp:400: 00000100:00100000:1.0:1788359266.249664:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420111488:12345-192.168.202.52@tcp:400: Request processed in 124us (13442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359266.249671:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:0.0:1788359266.252749:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420111872:12345-192.168.202.52@tcp:400: Request processed in 9512us (16530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359266.252771:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00080000:0.0:1788359266.252837:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788359266.685579:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788359266.823401:0:10182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788359267.004812:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359267.004853:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445324800:0@lo:13: 00000100:00100000:1.0:1788359267.005084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359267.005208:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324800 00000100:00100000:0.0:1788359267.005218:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324800 00000100:00100000:0.0:1788359267.005308:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359267.005319:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445324800:12345-0@lo:13: 00002000:00000024:0.0:1788359267.005362:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359267.005419:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445324800:12345-0@lo:13: Request processed in 102us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359267.005428:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788359267.005525:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359267.005712:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359267.005725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445324928:0@lo:13: 00000100:00100000:0.0:1788359267.005759:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788359267.005861:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c5c00 x1875230445324800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359267.005885:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445324800:0@lo:13: 00000100:00100000:0.0:1788359267.005990:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445324928 00000100:00100000:0.0:1788359267.005994:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445324928 00000100:00100000:0.0:1788359267.006029:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359267.006036:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445324928:12345-0@lo:13: 00002000:00000024:0.0:1788359267.006067:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359267.006103:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445324928:12345-0@lo:13: Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359267.006109:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788359267.006137:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c5500 x1875230445324928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359267.006150:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445324928:0@lo:13: 00000100:00080000:1.0:1788359267.006196:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359267.006869:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445325056:0@lo:400: 00000100:00100000:3.0:1788359267.007219:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445325312:0@lo:400: 00000100:00100000:1.0:1788359267.007334:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445325440:0@lo:400: 00000100:00100000:3.0:1788359267.007739:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.007775:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445325824:0@lo:400: 00000100:00100000:3.0:1788359267.007819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.007839:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445326336:0@lo:400: 00000100:00100000:3.0:1788359267.007864:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.007892:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788359267.007899:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445325184:0@lo:400: 00000100:00100000:3.0:1788359267.007933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.007953:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445325696:0@lo:400: 00000100:00100000:3.0:1788359267.007977:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.008006:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445326208:0@lo:400: 00000100:00100000:3.0:1788359267.008030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359267.008075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325312 00000100:00100000:3.0:1788359267.008083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325312 00000100:00100000:3.0:1788359267.008139:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788359267.008149:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445325312:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008228:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445325312:12345-0@lo:400: Request processed in 80us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008236:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788359267.008261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325824 00000100:00100000:3.0:1788359267.008265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325824 00000100:00100000:3.0:1788359267.008319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325184 00000100:00100000:3.0:1788359267.008323:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325184 00000100:00100000:3.0:1788359267.008335:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325696 00000100:00100000:3.0:1788359267.008337:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325696 00000100:00100000:3.0:1788359267.008352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326208 00000100:00100000:3.0:1788359267.008355:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326208 00000100:00100000:3.0:1788359267.008372:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359267.008378:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445325824:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008415:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445325824:12345-0@lo:400: Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359267.008434:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359267.008439:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445325184:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008467:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445325184:12345-0@lo:400: Request processed in 27us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008473:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359267.008484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788359267.008490:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445325696:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008543:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445325696:12345-0@lo:400: Request processed in 54us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788359267.008562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788359267.008568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445326208:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445326208:12345-0@lo:400: Request processed in 44us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788359267.008639:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326336 00000100:00100000:3.0:1788359267.008644:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326336 00000100:00100000:3.0:1788359267.008681:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359267.008688:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445326336:12345-0@lo:400: 00000100:00100000:3.0:1788359267.008722:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445326336:12345-0@lo:400: Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.008728:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359267.008790:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445325184:0@lo:400: 00000100:00100000:3.0:1788359267.008801:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445325696:0@lo:400: 00010000:00080000:3.0:1788359267.008815:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bc380 x1875230445326208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359267.008826:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445326208:0@lo:400: 00000100:00100000:3.0:1788359267.008838:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445325312:0@lo:400: 00010000:00080000:3.0:1788359267.008848:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bd880 x1875230445325824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359267.008856:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445325824:0@lo:400: 00010000:00080000:3.0:1788359267.008865:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74be300 x1875230445326336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359267.008873:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445326336:0@lo:400: 00000100:00080000:3.0:1788359267.008912:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359267.008927:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359267.008930:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359267.009345:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359267.009392:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445325952:0@lo:400: 00000100:00100000:1.0:1788359267.009431:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359267.009458:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445326464:0@lo:13: 00000100:00100000:1.0:1788359267.009484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359267.009531:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359267.009537:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445326592:0@lo:13: 00000100:00100000:1.0:1788359267.009566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359267.009608:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325440 00000100:00100000:1.0:1788359267.009614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325440 00000100:00100000:1.0:1788359267.009653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788359267.009662:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445325440:12345-0@lo:400: 00000100:00100000:1.0:1788359267.009711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445325440:12345-0@lo:400: Request processed in 51us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359267.009718:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788359267.009740:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326464 00000100:00100000:1.0:1788359267.009744:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326464 00000100:00100000:1.0:1788359267.009765:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326592 00000100:00100000:1.0:1788359267.009768:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326592 00000100:00100000:1.0:1788359267.009778:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788359267.009936:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325952 00000100:00100000:0.0:1788359267.009941:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325952 00000100:00100000:0.0:1788359267.009970:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359267.009978:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445325952:12345-0@lo:400: 00000100:00100000:0.0:1788359267.010018:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445325952:12345-0@lo:400: Request processed in 42us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359267.010024:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788359267.010127:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445326464:12345-0@lo:13: 00002000:00000024:1.0:1788359267.010146:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359267.010195:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445326464:12345-0@lo:13: Request processed in 411us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359267.010201:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788359267.010219:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788359267.010225:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445326592:12345-0@lo:13: 00002000:00000024:1.0:1788359267.010236:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359267.010264:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445326592:12345-0@lo:13: Request processed in 40us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359267.010269:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788359267.010342:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c5500 x1875230445326592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359267.010362:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445326592:0@lo:13: 00000100:00100000:1.0:1788359267.010375:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445325440:0@lo:400: 00010000:00080000:1.0:1788359267.010383:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bdf80 x1875230445325952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359267.010390:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445325952:0@lo:400: 00010000:00080000:1.0:1788359267.010398:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cb3800 x1875230445326464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359267.010408:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445326464:0@lo:13: 00000100:00080000:3.0:1788359267.011430:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359267.011986:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359267.012109:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445325568:0@lo:400: 00000100:00100000:2.0:1788359267.012179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359267.012213:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445326080:0@lo:400: 00000100:00100000:2.0:1788359267.012260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359267.012598:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326080 00000100:00100000:0.0:1788359267.012608:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326080 00000100:00100000:0.0:1788359267.012672:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788359267.012683:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445326080:12345-0@lo:400: 00000100:00100000:0.0:1788359267.012761:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445326080:12345-0@lo:400: Request processed in 80us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359267.012769:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788359267.013571:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325568 00000100:00100000:3.0:1788359267.013588:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325568 00000100:00100000:3.0:1788359267.013638:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788359267.013648:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445325568:12345-0@lo:400: 00000100:00100000:3.0:1788359267.013729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445325568:12345-0@lo:400: Request processed in 82us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359267.013736:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788359267.013764:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359267.014236:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445325568:0@lo:400: 00000100:00100000:2.0:1788359267.014254:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445326080:0@lo:400: 00000001:00100000:3.0:1788359267.015347:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000100:00100000:1.0:1788359267.015779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445325056 00000100:00100000:1.0:1788359267.015849:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445325056 00000100:00100000:0.0:1788359267.016082:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788359267.016095:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445325056:12345-0@lo:400: 00000100:00100000:0.0:1788359267.016215:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445325056:12345-0@lo:400: Request processed in 114us (4227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359267.016223:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788359267.016348:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445325056:0@lo:400: 00010000:00010000:3.0:1788359267.709070:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359268.736072:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359269.569654:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359269.569693:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445326720:0@lo:41: 00000100:00100000:2.0:1788359269.569812:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359269.570567:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326720 00000100:00100000:2.0:1788359269.570580:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326720 00000100:00100000:2.0:1788359269.570658:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359269.570669:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445326720:12345-0@lo:41: 00000004:00000024:2.0:1788359269.570723:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359269.570799:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445326720:12345-0@lo:41: Request processed in 132us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359269.570807:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359269.570860:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445326720:0@lo:41: 00010000:00010000:3.0:1788359269.756750:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359270.078012:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445326848:0@lo:41: 00000100:00100000:0.0:1788359270.078118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359270.078345:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445326848 00000100:00100000:1.0:1788359270.078357:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445326848 00000100:00100000:1.0:1788359270.078432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788359270.078445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445326848:12345-0@lo:41: 00000004:00000024:1.0:1788359270.078564:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788359270.078628:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445326848:12345-0@lo:41: Request processed in 186us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.078637:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788359270.078960:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445326848:0@lo:41: 00000020:00000080:1.0:1788359270.661687:0:10329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebbd48d40 20000000:00000080:1.0:1788359270.661711:0:10329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0eaffaad400 uarg=0000000000000000 20000000:01000000:1.0:1788359270.661779:0:10329:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788359270.661783:0:10329:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788359270.661787:0:10329:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788359270.661793:0:10329:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788359270.661800:0:10329:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788359270.661883:0:10329:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788359270.661887:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788359270.663170:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788359270.663643:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788359270.663683:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788359270.663699:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788359270.663714:0:10329:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788359270.663717:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788359270.675333:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788359270.675824:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788359270.675864:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788359270.675882:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788359270.675896:0:10329:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788359270.675899:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788359270.682169:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788359270.682812:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788359270.682860:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788359270.682879:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788359270.682892:0:10329:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788359270.682896:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788359270.688990:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788359270.694612:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788359270.694780:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788359270.694807:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788359270.694827:0:10329:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788359270.694830:0:10329:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788359270.697909:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788359270.700140:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788359270.700193:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788359270.700209:0:10329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1788359270.700232:0:10329:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788359270.700291:0:10329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700315:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae32d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700324:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae357 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700332:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700339:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700347:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700354:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700361:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700384:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700392:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae43e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700402:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700410:0:10329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700417:0:10329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700469:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.700491:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 9 pid: 6509 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.701622:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445326976:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359270.701888:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.701901:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 9 pid: 6508 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.701911:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327104:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359270.701969:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.701979:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.701990:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327232:0@lo:104: 00000100:00100000:0.0:1788359270.702050:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.702102:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702110:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702119:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327360:0@lo:104: 00000100:00100000:0.0:1788359270.702157:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.702180:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702187:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702195:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327488:0@lo:104: 00000100:00100000:0.0:1788359270.702215:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.702235:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702243:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 23 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702276:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327616:0@lo:104: 00000100:00100000:0.0:1788359270.702303:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.702321:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702330:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 23 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702338:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327744:0@lo:104: 00010000:00010000:0.0:1788359270.702362:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702369:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 23 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702377:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327872:0@lo:104: 00000100:00100000:2.0:1788359270.702383:0:8447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788359270.702400:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.702404:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.702408:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.702415:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359270.702416:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328000:0@lo:104: 00000100:00100000:2.0:1788359270.702424:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327232 00000100:00100000:0.0:1788359270.702434:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359270.702437:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327232 00010000:00010000:0.0:1788359270.702449:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.702456:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 23 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.702471:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328128:0@lo:104: 00000100:00100000:2.0:1788359270.702489:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327360 00000100:00100000:0.0:1788359270.702491:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359270.702512:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327360 00000100:00100000:2.0:1788359270.702525:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327488 00000100:00100000:2.0:1788359270.702528:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327488 00010000:00010000:0.0:1788359270.702530:0:10329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.702537:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327616 00000100:00100000:2.0:1788359270.702539:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327616 00010000:00010000:0.0:1788359270.702539:0:10329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 23 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.702546:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327744 00000100:00100000:2.0:1788359270.702548:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327744 00000100:00100000:0.0:1788359270.702548:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328256:0@lo:104: 00000100:00100000:0.0:1788359270.702568:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359270.702578:0:10329:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359270.702637:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445327872 00000100:00100000:2.0:1788359270.702641:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445327872 00000100:00100000:2.0:1788359270.702653:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328000 00000100:00100000:2.0:1788359270.702656:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328000 00000100:00100000:2.0:1788359270.703120:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328128 00000100:00100000:2.0:1788359270.703126:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328128 00000100:00100000:2.0:1788359270.703137:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328256 00000100:00100000:2.0:1788359270.703140:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328256 00000100:00100000:2.0:1788359270.703154:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359270.703163:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:10329:x1875230445327232:12345-0@lo:104: 00010000:00010000:2.0:1788359270.703180:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.703270:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788359270.703276:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:10329:x1875230445327232:12345-0@lo:104: Request processed in 114us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359270.703284:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788359270.703387:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788359270.703403:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+11:10329:x1875230445327360:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703413:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.703443:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359270.703450:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:10329:x1875230445327488:12345-0@lo:104: 00010000:00010000:2.0:1788359270.703458:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359270.703459:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359270.703463:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+10:10329:x1875230445327360:12345-0@lo:104: Request processed in 68us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703469:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788359270.703481:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359270.703487:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c634f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:10329:x1875230445327616:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703510:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.703519:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788359270.703523:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+9:10329:x1875230445327488:12345-0@lo:104: Request processed in 75us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359270.703530:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359270.703544:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788359270.703545:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788359270.703550:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+8:10329:x1875230445327744:12345-0@lo:104: 00000100:00100000:1.0:1788359270.703550:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c634f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+8:10329:x1875230445327616:12345-0@lo:104: Request processed in 63us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703555:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359270.703595:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788359270.703601:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+7:10329:x1875230445327872:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703609:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359270.703637:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788359270.703642:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+7:10329:x1875230445327872:12345-0@lo:104: Request processed in 42us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703648:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788359270.703678:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359270.703685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:10329:x1875230445328000:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703692:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359270.703718:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788359270.703723:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:10329:x1875230445328000:12345-0@lo:104: Request processed in 40us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703728:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359270.703739:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788359270.703745:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:10329:x1875230445328128:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703752:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359270.703785:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788359270.703789:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:10329:x1875230445328128:12345-0@lo:104: Request processed in 45us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703795:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788359270.703807:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788359270.703813:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:10329:x1875230445328256:12345-0@lo:104: 00010000:00010000:1.0:1788359270.703821:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359270.703845:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788359270.703849:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:10329:x1875230445328256:12345-0@lo:104: Request processed in 37us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359270.703855:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788359270.703956:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.703989:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788359270.703994:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:10329:x1875230445327744:12345-0@lo:104: Request processed in 444us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359270.704000:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788359270.704102:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1788359270.704111:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704119:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056a00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704124:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704134:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704142:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704148:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704195:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704213:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704243:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704262:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056a00/0x49dd053b5feae43e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae445 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.704268:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788359270.704277:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1788359270.704280:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.704284:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445328384:0@lo:103: 00010000:00010000:0.0:1788359270.704286:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704289:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704296:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704302:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704308:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704325:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704332:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704337:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704344:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae41b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704363:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788359270.704365:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704371:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704374:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704380:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704386:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704391:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788359270.704404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.704404:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704410:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704424:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704431:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae3f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ff expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704440:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788359270.704443:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.704444:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445328512:0@lo:103: 00010000:00010000:0.0:1788359270.704459:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704462:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.704466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359270.704470:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704477:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704483:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704521:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.704522:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328384 00010000:00010000:0.0:1788359270.704528:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788359270.704529:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328384 00010000:00010000:0.0:1788359270.704533:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704539:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40200/0x49dd053b5feae3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3d5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704548:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788359270.704552:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704558:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14bc00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704561:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704579:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704585:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704590:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704603:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704610:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704619:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704626:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14bc00/0x49dd053b5feae3a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3ab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704635:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788359270.704639:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704645:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704647:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704653:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704669:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704683:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704696:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704702:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704707:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704714:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056c00/0x49dd053b5feae396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae39d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704724:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788359270.704727:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704732:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704735:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704742:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704748:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704754:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704767:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704773:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704783:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704791:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae35e expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704800:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359270.704804:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704809:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704812:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704818:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704824:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704829:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704859:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704866:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704870:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704876:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eadbea4200/0x49dd053b5feae32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae334 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704887:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359270.704895:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704901:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359270.704904:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704910:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359270.704917:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359270.704923:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359270.704949:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704956:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359270.704960:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704967:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae3b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.704969:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 24 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.704984:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359270.704987:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359270.704989:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359270.705004:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445328640:0@lo:103: 00000100:00100000:2.0:1788359270.705007:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328512 00000100:00100000:2.0:1788359270.705011:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328512 00010000:00010000:2.0:1788359270.705025:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.705040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359270.705144:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445328896:0@lo:103: 00000100:00100000:1.0:1788359270.705177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359270.707156:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445329152:0@lo:103: 00000100:00100000:0.0:1788359270.707647:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445328768:0@lo:103: 00000100:00100000:1.0:1788359270.708343:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445329408:0@lo:103: 00000100:00100000:1.0:1788359270.708384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359270.711449:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328640 00000100:00100000:2.0:1788359270.711473:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328640 00010000:00010000:2.0:1788359270.711952:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 26 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.712005:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328896 00000100:00100000:2.0:1788359270.712011:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328896 00010000:00010000:2.0:1788359270.712031:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 27 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.712049:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359270.712060:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+27:3645:x1875230445328384:12345-0@lo:103: 00010000:00010000:2.0:1788359270.712081:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359270.712089:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 27 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.712103:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 27 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.712133:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359270.712228:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+27:3645:x1875230445328384:12345-0@lo:103: Request processed in 169us (7822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359270.712235:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359270.713097:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359270.713111:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+26:3645:x1875230445328512:12345-0@lo:103: 00010000:00010000:2.0:1788359270.713126:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359270.713133:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 26 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.713167:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 26 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.713184:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359270.713235:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+26:3645:x1875230445328512:12345-0@lo:103: Request processed in 126us (8767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359270.713242:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359270.713270:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359270.713277:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3642:x1875230445328640:12345-0@lo:103: 00010000:00010000:2.0:1788359270.713285:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788359270.713433:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788359270.713444:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3644:x1875230445328896:12345-0@lo:103: 00010000:00010000:3.0:1788359270.713455:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359270.713461:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.713471:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 25 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.713482:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.713537:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3644:x1875230445328896:12345-0@lo:103: Request processed in 96us (8359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.713545:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788359270.713581:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359270.714011:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 24 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.714013:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae445 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae43e expref: 24 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.714021:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 24 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.714031:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359270.714032:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327232:0@lo:104: 00010000:00010000:0.0:1788359270.714045:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a800/0x49dd053b5feae41b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae414 expref: 23 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.714054:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327360:0@lo:104: 00010000:00010000:0.0:1788359270.714064:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae3ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae3f8 expref: 22 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.714071:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327488:0@lo:104: 00000100:00100000:0.0:1788359270.714082:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327616:0@lo:104: 00000100:00100000:2.0:1788359270.714088:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3642:x1875230445328640:12345-0@lo:103: Request processed in 813us (9047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359270.714091:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327744:0@lo:104: 00000100:00100000:2.0:1788359270.714094:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788359270.714101:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea4a00/0x49dd053b5feae3ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae3a4 expref: 21 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.714110:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327872:0@lo:104: 00000100:00100000:0.0:1788359270.714121:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328000:0@lo:104: 00000100:00100000:0.0:1788359270.714130:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328128:0@lo:104: 00000100:00100000:0.0:1788359270.714139:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445328256:0@lo:104: 00000100:00100000:2.0:1788359270.714155:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445329024:0@lo:103: 00000100:00100000:1.0:1788359270.714352:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445328896:0@lo:103: 00000100:00100000:2.0:1788359270.714372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359270.715011:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329408 00000100:00100000:3.0:1788359270.715021:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329408 00000100:00100000:2.0:1788359270.715055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359270.715058:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 20 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359270.715083:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329024 00000100:00100000:2.0:1788359270.715085:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445329280:0@lo:103: 00000100:00100000:3.0:1788359270.715086:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329024 00010000:00010000:3.0:1788359270.715096:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 21 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359270.715105:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445328768 00000100:00100000:3.0:1788359270.715107:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445328768 00010000:00010000:3.0:1788359270.715117:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 22 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715118:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359270.715126:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329280 00000100:00100000:3.0:1788359270.715129:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329280 00010000:00010000:3.0:1788359270.715138:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 23 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359270.715151:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788359270.715158:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3644:x1875230445329408:12345-0@lo:103: 00000100:00100000:2.0:1788359270.715169:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445328640:0@lo:103: 00010000:00010000:3.0:1788359270.715194:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359270.715200:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 23 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715203:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329152 00000100:00100000:2.0:1788359270.715206:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329152 00010000:00010000:3.0:1788359270.715210:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 24 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.715220:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 24 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.715232:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a600/0x49dd053b5feae3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae3b2 expref: 24 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715234:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788359270.715239:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3645:x1875230445329024:12345-0@lo:103: 00010000:00010000:3.0:1788359270.715257:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359270.715258:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359270.715262:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.715271:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.715281:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea4c00/0x49dd053b5feae39d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae396 expref: 23 pid: 6509 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359270.715295:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3644:x1875230445329408:12345-0@lo:103: Request processed in 137us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.715302:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788359270.715303:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.715317:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359270.715322:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3643:x1875230445328768:12345-0@lo:103: 00000100:00100000:2.0:1788359270.715324:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3645:x1875230445329024:12345-0@lo:103: Request processed in 86us (953us total) trans 0 rc 0/0 00010000:00010000:3.0:1788359270.715330:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788359270.715330:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788359270.715334:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 21 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715340:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788359270.715342:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 20 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.715345:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3643:x1875230445329280:12345-0@lo:103: 00010000:00010000:2.0:1788359270.715351:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359270.715353:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae3d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae3ce expref: 20 pid: 6510 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.715355:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 20 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.715363:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 19 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359270.715402:0:6501:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788359270.715413:0:6501:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788359270.715613:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445329024:0@lo:103: 00000100:00100000:0.0:1788359270.715624:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445328512:0@lo:103: 00000100:00100000:0.0:1788359270.715645:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445328384:0@lo:103: 00010000:00010000:3.0:1788359270.715907:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.715989:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3643:x1875230445328768:12345-0@lo:103: Request processed in 665us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.715996:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359270.716011:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788359270.716020:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:3642:x1875230445329152:12345-0@lo:103: 00010000:00010000:3.0:1788359270.716030:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359270.716035:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 18 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.716053:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 18 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.716066:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41e00/0x49dd053b5feae35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae357 expref: 18 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.716078:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.716119:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:3642:x1875230445329152:12345-0@lo:103: Request processed in 102us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.716125:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788359270.716244:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445329152:0@lo:103: 00000100:00100000:0.0:1788359270.716308:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445328768:0@lo:103: 00000100:00100000:1.0:1788359270.717528:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359270.717622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359270.717746:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445326976:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359270.717758:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10329:1875230445327104:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359270.717794:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea5000/0x49dd053b5feae334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae32d expref: 16 pid: 6508 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.717818:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359270.717820:0:10329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.717878:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:3643:x1875230445329280:12345-0@lo:103: Request processed in 2532us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359270.717942:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445329280:0@lo:103: 00000100:00100000:3.0:1788359270.718459:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112128 00000100:00100000:3.0:1788359270.718469:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112128 00000100:00100000:0.0:1788359270.718587:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445329408:0@lo:103: 00010000:00010000:3.0:1788359270.718887:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 10 pid: 6508 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359270.719165:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359270.719185:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112000 00000100:00100000:3.0:1788359270.719190:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112000 00000100:00100000:2.0:1788359270.719195:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:2.0:1788359270.719206:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2405:x1875230420112128:12345-192.168.202.52@tcp:103: 00010000:00010000:3.0:1788359270.719207:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 11 pid: 6509 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359270.719219:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 34 00010000:00010000:2.0:1788359270.719223:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788359270.719224:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2405:x1875230420112000:12345-192.168.202.52@tcp:103: 00010000:00010000:2.0:1788359270.719229:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 11 pid: 6508 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.719231:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359270.719235:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 11 pid: 6509 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.719240:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 11 pid: 6508 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.719262:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 11 pid: 6509 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.720046:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057e00/0x49dd053b5feae453 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6cfc expref: 11 pid: 6508 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720132:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae45a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d03 expref: 10 pid: 6509 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720149:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720158:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720181:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720188:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720195:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720202:0:7465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720209:0:7465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359270.720214:0:7465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720223:0:7465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720325:0:7465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359270.720354:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.720435:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:2405:x1875230420112000:12345-192.168.202.52@tcp:103: Request processed in 1208us (2811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.720445:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 34 00010000:00010000:0.0:1788359270.722114:0:10329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.722134:0:10329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359270.722141:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae499 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359270.724726:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359270.724950:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:2405:x1875230420112128:12345-192.168.202.52@tcp:103: Request processed in 5733us (7443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359270.724967:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 33 00010000:00010000:0.0:1788359270.785188:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359271.355138:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359271.355258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359271.356654:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112384 00000100:00100000:2.0:1788359271.356671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112384 00000100:00100000:2.0:1788359271.356777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:2.0:1788359271.356792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2402:x1875230420112384:12345-192.168.202.52@tcp:400: 00000100:00100000:2.0:1788359271.356894:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2402:x1875230420112384:12345-192.168.202.52@tcp:400: Request processed in 108us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359271.356901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00080000:0.0:1788359271.357762:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359271.358125:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112256 00000100:00100000:3.0:1788359271.358137:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112256 00000100:00100000:2.0:1788359271.358319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359271.358371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359271.358400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359271.358438:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112640 00000100:00100000:2.0:1788359271.358454:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112640 00000100:00100000:2.0:1788359271.358515:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112768 00000100:00100000:2.0:1788359271.358518:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112768 00000100:00100000:1.0:1788359271.358626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112512 00000100:00100000:1.0:1788359271.358641:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112512 00000100:00100000:1.0:1788359271.358667:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:1.0:1788359271.358677:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420112512:12345-192.168.202.52@tcp:400: 00000100:00100000:1.0:1788359271.358741:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420112512:12345-192.168.202.52@tcp:400: Request processed in 68us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359271.358749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:2.0:1788359271.358875:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:2.0:1788359271.358887:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420112640:12345-192.168.202.52@tcp:400: 00000100:00100000:2.0:1788359271.358924:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420112640:12345-192.168.202.52@tcp:400: Request processed in 40us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359271.359416:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:0.0:1788359271.359431:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:2402:x1875230420112256:12345-192.168.202.52@tcp:400: 00000100:00100000:0.0:1788359271.359560:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:2402:x1875230420112256:12345-192.168.202.52@tcp:400: Request processed in 133us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359271.359568:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:1.0:1788359271.359807:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:1.0:1788359271.359819:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420112768:12345-192.168.202.52@tcp:400: 00000100:00100000:1.0:1788359271.359851:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420112768:12345-192.168.202.52@tcp:400: Request processed in 36us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359271.359858:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00080000:1.0:1788359271.359882:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359271.359887:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359271.359890:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359271.360169:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00010000:00010000:3.0:1788359271.804828:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788359272.061412:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788359272.061424:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaff1c4000 from 48 10000000:01000000:2.0:1788359272.061432:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359272.061824:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.061839:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.061854:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.061889:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329536:0@lo:101: 00000100:00100000:2.0:1788359272.061990:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.062058:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.064556:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329536 00000100:00100000:0.0:1788359272.064575:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329536 00000100:00100000:0.0:1788359272.064664:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788359272.064676:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+15:6512:x1875230445329536:12345-0@lo:101: 00010000:00010000:0.0:1788359272.064698:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359272.064722:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae4a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4a0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.064767:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4a0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.064779:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4a0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.064791:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a400, rc 0) 00000100:00100000:0.0:1788359272.064901:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445329536:12345-0@lo:101: Request processed in 227us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.064908:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788359272.067760:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329536:0@lo:101: 00010000:00010000:1.0:1788359272.067804:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359272.067821:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359272.067949:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329664:0@lo:501: 00000100:00100000:1.0:1788359272.068033:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.068111:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead15d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.068186:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329664 00000100:00100000:3.0:1788359272.068195:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329664 00000100:00100000:3.0:1788359272.068294:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788359272.068317:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445329664:12345-0@lo:501: 00000100:00100000:3.0:1788359272.068561:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445329664:12345-0@lo:501: Request processed in 246us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.068569:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788359272.069007:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329664:0@lo:501: 00000100:00100000:1.0:1788359272.069049:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329792:0@lo:503: 00000100:00100000:1.0:1788359272.069125:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.069166:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead15d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.069881:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329792 00000100:00100000:3.0:1788359272.069892:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329792 00000100:00100000:3.0:1788359272.069956:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788359272.069967:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445329792:12345-0@lo:503: 00000100:00100000:3.0:1788359272.070130:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445329792:12345-0@lo:503: Request processed in 164us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.070140:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788359272.070266:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445329792:0@lo:503: 00000100:00100000:3.0:1788359272.070965:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10347:1875230445329920:0@lo:502: 00000100:00100000:3.0:1788359272.071034:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.071088:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.071143:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445329920 00000100:00100000:1.0:1788359272.071150:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445329920 00000100:00100000:1.0:1788359272.071190:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788359272.071209:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:10347:x1875230445329920:12345-0@lo:502: 00000100:00100000:1.0:1788359272.071636:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:10347:x1875230445329920:12345-0@lo:502: Request processed in 436us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.071645:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788359272.071743:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10347:1875230445329920:0@lo:502: 00000100:00100000:3.0:1788359272.071796:0:10347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10347:1875230445330048:0@lo:502: 00000100:00100000:3.0:1788359272.071835:0:10347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.071870:0:10347:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.071919:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330048 00000100:00100000:1.0:1788359272.071924:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330048 00000100:00100000:1.0:1788359272.072050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788359272.072060:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:10347:x1875230445330048:12345-0@lo:502: 00000100:00100000:1.0:1788359272.072156:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:10347:x1875230445330048:12345-0@lo:502: Request processed in 98us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.072164:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788359272.072269:0:10347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10347:1875230445330048:0@lo:502: 00000040:00080000:2.0:1788359272.072291:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788359272.074194:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788359272.074269:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359272.074286:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.074311:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359272.074324:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788359272.074328:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788359272.074331:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788359272.074389:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.074398:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.074411:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.074446:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330176:0@lo:101: 00000100:00100000:2.0:1788359272.074683:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.078752:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac85719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.079099:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330176 00000100:00100000:3.0:1788359272.079112:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330176 00000100:00100000:3.0:1788359272.079191:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788359272.079376:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+16:6512:x1875230445330176:12345-0@lo:101: 00010000:00010000:3.0:1788359272.079402:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359272.079429:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae4b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4ae expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.079470:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4ae expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.079484:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae4b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4ae expref: 17 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.079644:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0030200, rc 0) 00000100:00100000:3.0:1788359272.079753:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330176:12345-0@lo:101: Request processed in 551us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.079761:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788359272.079944:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330176:0@lo:101: 00010000:00010000:2.0:1788359272.079970:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.079981:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.080106:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330304:0@lo:501: 00000100:00100000:2.0:1788359272.080149:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.080178:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac85719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.080267:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330304 00000100:00100000:0.0:1788359272.080275:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330304 00000100:00100000:0.0:1788359272.080474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788359272.080486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330304:12345-0@lo:501: 00000100:00100000:0.0:1788359272.080695:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330304:12345-0@lo:501: Request processed in 210us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.080703:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788359272.080923:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330304:0@lo:501: 00000100:00100000:2.0:1788359272.080960:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330432:0@lo:503: 00000100:00100000:2.0:1788359272.081016:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.081037:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac85719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.081091:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330432 00000100:00100000:0.0:1788359272.081096:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330432 00000100:00100000:0.0:1788359272.081129:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788359272.081136:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330432:12345-0@lo:503: 00000100:00100000:0.0:1788359272.081725:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330432:12345-0@lo:503: Request processed in 587us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.081735:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788359272.081825:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330432:0@lo:503: 00000100:00100000:2.0:1788359272.085864:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10348:1875230445330560:0@lo:502: 00000100:00100000:2.0:1788359272.086008:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.086138:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.086476:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330560 00000100:00100000:3.0:1788359272.086487:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330560 00000100:00100000:3.0:1788359272.086830:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788359272.086842:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:10348:x1875230445330560:12345-0@lo:502: 00000100:00100000:3.0:1788359272.087045:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:10348:x1875230445330560:12345-0@lo:502: Request processed in 205us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.087062:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788359272.087165:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10348:1875230445330560:0@lo:502: 00000020:01000000:2.0:1788359272.087205:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359272.087217:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359272.087219:0:10348:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788359272.087224:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788359272.087270:0:10348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10348:1875230445330688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.087326:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.087578:0:10348:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.087764:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330688 00000100:00100000:0.0:1788359272.087771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330688 00000100:00100000:0.0:1788359272.087808:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788359272.087816:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:10348:x1875230445330688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.087942:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:10348:x1875230445330688:12345-0@lo:502:llog_process_th.0 Request processed in 125us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.087950:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788359272.088067:0:10348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10348:1875230445330688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359272.088088:0:10348:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359272.088094:0:10348:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359272.088096:0:10348:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788359272.088100:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788359272.088326:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788359272.088361:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788359272.088374:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.088387:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359272.088400:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788359272.088404:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6d76800 from 48 10000000:01000000:0.0:1788359272.088408:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359272.088444:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.088452:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.088462:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.088531:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.088575:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.088599:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.088794:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330816 00000100:00100000:2.0:1788359272.088800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330816 00000100:00100000:2.0:1788359272.088831:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788359272.088840:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+17:6512:x1875230445330816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359272.088853:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359272.088869:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae4c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4bc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.088895:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4bc expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.088906:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4bc expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.088916:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40200, rc 0) 00000100:00100000:2.0:1788359272.088964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445330816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.088971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788359272.089046:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.089062:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.089072:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.089132:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.089158:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.089221:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.089287:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445330944 00000100:00100000:3.0:1788359272.089292:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445330944 00000100:00100000:1.0:1788359272.089440:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788359272.089455:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445330944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.089733:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445330944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.089742:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788359272.089827:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445330944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.089859:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.089906:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.089935:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.089980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331072 00000100:00100000:2.0:1788359272.089986:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331072 00000100:00100000:2.0:1788359272.090019:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788359272.090026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445331072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.090119:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445331072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.090126:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788359272.090227:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.090773:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10349:1875230445331200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.090820:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.090852:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.091059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331200 00000100:00100000:2.0:1788359272.091066:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331200 00000100:00100000:2.0:1788359272.091169:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788359272.091178:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:10349:x1875230445331200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.091333:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:10349:x1875230445331200:12345-0@lo:502:llog_process_th.0 Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.091340:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788359272.091477:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10349:1875230445331200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.091561:0:10349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10349:1875230445331328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.091606:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.091625:0:10349:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.091843:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331328 00000100:00100000:2.0:1788359272.091848:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331328 00000100:00100000:2.0:1788359272.091869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788359272.091875:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:10349:x1875230445331328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.091953:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:10349:x1875230445331328:12345-0@lo:502:llog_process_th.0 Request processed in 77us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.091961:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788359272.092031:0:10349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10349:1875230445331328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788359272.092051:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788359272.092255:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788359272.092285:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359272.092362:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.092376:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359272.092387:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788359272.092391:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788359272.092394:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788359272.092429:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.092439:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.092449:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.092473:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.092680:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.092718:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.092775:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331456 00000100:00100000:0.0:1788359272.092781:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331456 00000100:00100000:0.0:1788359272.092810:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788359272.092819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+18:6512:x1875230445331456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.092830:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359272.092846:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae4d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4ca expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.092873:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4ca expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.092885:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae4d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4ca expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.092895:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14aa00, rc 0) 00000100:00100000:0.0:1788359272.092937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445331456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.092944:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788359272.093101:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359272.093117:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.093127:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.093183:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.093210:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.093230:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.093279:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331584 00000100:00100000:3.0:1788359272.093284:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331584 00000100:00100000:3.0:1788359272.093419:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788359272.093427:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445331584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.093600:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445331584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.093607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788359272.093700:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.093732:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.093778:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.094028:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.094057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331712 00000100:00100000:0.0:1788359272.094062:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331712 00000100:00100000:0.0:1788359272.094115:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788359272.094122:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445331712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.094290:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445331712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.094376:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788359272.094471:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445331712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.094956:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10350:1875230445331840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.094999:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.095066:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359272.095107:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331840 00000100:00100000:3.0:1788359272.095112:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331840 00000100:00100000:3.0:1788359272.095169:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788359272.095177:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:10350:x1875230445331840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359272.095288:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:10350:x1875230445331840:12345-0@lo:502:llog_process_th.0 Request processed in 112us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.095296:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788359272.095365:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10350:1875230445331840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359272.095388:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359272.095398:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359272.095401:0:10350:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788359272.095406:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788359272.095428:0:10350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10350:1875230445331968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.095456:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.095778:0:10350:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.095807:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445331968 00000100:00100000:0.0:1788359272.095812:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445331968 00000100:00100000:2.0:1788359272.095852:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788359272.095861:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:10350:x1875230445331968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.095945:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:10350:x1875230445331968:12345-0@lo:502:llog_process_th.0 Request processed in 85us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.095952:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788359272.096050:0:10350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10350:1875230445331968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359272.096068:0:10350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359272.096073:0:10350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359272.096075:0:10350:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788359272.096079:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788359272.096266:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788359272.096294:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788359272.102450:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.102471:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359272.102598:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788359272.102604:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaf6cef800 from 48 10000000:01000000:3.0:1788359272.102609:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788359272.102669:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.102678:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.102690:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359272.102750:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.102854:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.102913:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.103085:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332096 00000100:00100000:1.0:1788359272.103096:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332096 00000100:00100000:1.0:1788359272.103161:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788359272.103173:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:6512:x1875230445332096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359272.103191:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359272.103207:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02056c00/0x49dd053b5feae4df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4d8 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359272.103248:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056c00/0x49dd053b5feae4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4d8 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359272.103260:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02056c00/0x49dd053b5feae4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4d8 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359272.103270:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056c00, rc 0) 00000100:00100000:1.0:1788359272.103640:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445332096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 468us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.103659:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788359272.103761:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359272.103779:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.103790:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359272.103879:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.103913:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.103945:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.105070:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332224 00000100:00100000:1.0:1788359272.105084:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332224 00000100:00100000:1.0:1788359272.105154:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788359272.105165:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445332224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.105866:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445332224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 700us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.105876:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788359272.111079:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.111913:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.112033:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.112096:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.112170:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332352 00000100:00100000:1.0:1788359272.112180:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332352 00000100:00100000:1.0:1788359272.112329:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788359272.112343:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445332352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.112816:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445332352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 475us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.112825:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788359272.112943:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445332352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.113588:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10351:1875230445332480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359272.113658:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.123703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332480 00000100:00100000:0.0:1788359272.123724:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332480 00000100:00100000:3.0:1788359272.123771:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.123872:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788359272.123884:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:10351:x1875230445332480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.124175:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:10351:x1875230445332480:12345-0@lo:502:llog_process_th.0 Request processed in 293us (10516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.124184:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788359272.124719:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445332608:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.124781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.124813:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445332992:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.124815:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445333120:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.124837:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.124850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.124853:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445333632:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.124872:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445333504:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.124875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.124895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.124905:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332608 00000100:00100000:0.0:1788359272.124911:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332608 00000100:00100000:2.0:1788359272.124912:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445334016:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.124932:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.124944:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333120 00000100:00100000:0.0:1788359272.124947:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333120 00000100:00100000:2.0:1788359272.124956:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445332864:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.124970:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333632 00000100:00100000:0.0:1788359272.124973:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333632 00000100:00100000:2.0:1788359272.124980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.124987:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332864 00000100:00100000:0.0:1788359272.124989:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332864 00000100:00100000:2.0:1788359272.124991:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445333376:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125003:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788359272.125010:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.125011:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445332608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.125025:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445333888:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.125050:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.125057:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445332608:12345-0@lo:400:kworker.0 Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.125068:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359272.125073:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445332736:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125075:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788359272.125088:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788359272.125095:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445333120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.125107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.125121:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445333120:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.125124:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445333248:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125127:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788359272.125138:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788359272.125143:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445333632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.125145:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.125154:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445333760:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125166:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445333632:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.125171:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788359272.125180:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333248 00000100:00100000:2.0:1788359272.125181:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.125184:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333248 00000100:00100000:0.0:1788359272.125199:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333760 00000100:00100000:0.0:1788359272.125201:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333760 00000100:00100000:0.0:1788359272.125215:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788359272.125220:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445332864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125269:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445332864:12345-0@lo:400:kworker.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.125276:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788359272.125288:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788359272.125293:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445333248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125320:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445333248:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.125660:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788359272.125681:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788359272.125687:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445333760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125727:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445333760:12345-0@lo:400:kworker.0 Request processed in 40us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.125744:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788359272.125817:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445334144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359272.125843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.125882:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445333120:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7243b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445333632:0@lo:400:kworker.0 00000100:00100000:0.0:1788359272.125901:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445332608:0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126096:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445334272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359272.126130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.126169:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333504 00000100:00100000:1.0:1788359272.126173:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333504 00000100:00100000:1.0:1788359272.126213:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334016 00000100:00100000:1.0:1788359272.126217:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334016 00000100:00100000:1.0:1788359272.126242:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333376 00000100:00100000:1.0:1788359272.126246:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333376 00000100:00100000:1.0:1788359272.126264:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445333888 00000100:00100000:1.0:1788359272.126267:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445333888 00000100:00100000:1.0:1788359272.126281:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788359272.126288:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445333504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126344:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445333504:12345-0@lo:400:kworker.0 Request processed in 56us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.126352:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788359272.126365:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788359272.126372:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445334016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126401:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445334016:12345-0@lo:400:kworker.0 Request processed in 30us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.126407:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788359272.126419:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788359272.126424:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445333376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126452:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445333376:12345-0@lo:400:kworker.0 Request processed in 28us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.126457:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788359272.126468:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788359272.126474:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445333888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126643:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445333888:12345-0@lo:400:kworker.0 Request processed in 45us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.126644:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10351:1875230445332480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.126651:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788359272.126677:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359272.126682:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359272.126684:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359272.126686:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359272.126703:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332992 00000100:00100000:1.0:1788359272.126708:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332992 00000100:00100000:3.0:1788359272.126714:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10351:1875230445334400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.126737:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445332736 00000100:00100000:1.0:1788359272.126740:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445332736 00000100:00100000:1.0:1788359272.126755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788359272.126769:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445332992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445332992:12345-0@lo:400:kworker.0 Request processed in 39us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.126813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788359272.126826:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788359272.126831:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.126832:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445332736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359272.126859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445332736:12345-0@lo:400:kworker.0 Request processed in 28us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359272.126861:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.126865:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788359272.126965:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334144 00000100:00100000:1.0:1788359272.126969:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334144 00000100:00100000:1.0:1788359272.126986:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334272 00000100:00100000:1.0:1788359272.126989:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334272 00000100:00100000:1.0:1788359272.127001:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359272.127006:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445334144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359272.127030:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359272.127063:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445334144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.127069:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788359272.127078:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788359272.127083:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445334272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359272.127098:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359272.127122:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445334272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.127127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788359272.127164:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7533100 x1875230445334144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359272.127190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445334144:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788359272.127193:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7532d80 x1875230445334272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359272.127203:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359272.127205:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445334272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359272.127209:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445334656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359272.127214:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359272.127219:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445334528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359272.127453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.127615:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.127635:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334656 00000100:00100000:1.0:1788359272.127640:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334656 00000100:00100000:1.0:1788359272.127659:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334528 00000100:00100000:1.0:1788359272.127663:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334528 00000100:00100000:1.0:1788359272.127676:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788359272.127683:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445334656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359272.127695:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359272.127729:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445334656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.127736:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788359272.127748:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788359272.127754:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445334528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359272.127764:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359272.127793:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445334528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.127799:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788359272.127825:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7397480 x1875230445334528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788359272.127836:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7396680 x1875230445334656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359272.127839:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445334528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359272.127846:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445334656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359272.127950:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445332992:0@lo:400:kworker.0 00010000:00080000:2.0:1788359272.127965:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7242300 x1875230445333504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359272.127974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445333504:0@lo:400:kworker.0 00000100:00100000:3.0:1788359272.127979:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445332736:0@lo:400:kworker.0 00010000:00080000:2.0:1788359272.127985:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7240000 x1875230445334016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788359272.127992:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bdf80 x1875230445333248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359272.127993:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7240000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445334016:0@lo:400:kworker.0 00000100:00100000:3.0:1788359272.128001:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445333248:0@lo:400:kworker.0 00010000:00080000:3.0:1788359272.128012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7242a00 x1875230445333760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359272.128020:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445333760:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.128020:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334400 00000100:00100000:2.0:1788359272.128023:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334400 00000100:00100000:3.0:1788359272.128033:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445332864:0@lo:400:kworker.0 00010000:00080000:3.0:1788359272.128044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b2300 x1875230445333376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359272.128052:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445333376:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.128058:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788359272.128064:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:10351:x1875230445334400:12345-0@lo:502:llog_process_th.0 00010000:00080000:3.0:1788359272.128074:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7241f80 x1875230445333888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359272.128083:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445333888:0@lo:400:kworker.0 00000100:00100000:2.0:1788359272.128838:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:10351:x1875230445334400:12345-0@lo:502:llog_process_th.0 Request processed in 769us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.128849:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788359272.128870:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10351:1875230445334400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788359272.128904:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788359272.128991:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788359272.129015:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359272.129027:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.129038:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359272.129049:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788359272.129052:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788359272.129055:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788359272.129097:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.129104:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.129112:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.129129:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445334784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.129156:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.129213:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571900 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.129255:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334784 00000100:00100000:1.0:1788359272.129269:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334784 00000100:00100000:0.0:1788359272.131688:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788359272.131722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445334784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.131813:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359272.131843:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14bc00/0x49dd053b5feae4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4e6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.131885:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14bc00/0x49dd053b5feae4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4e6 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.131898:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14bc00/0x49dd053b5feae4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4e6 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.131908:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14bc00, rc 0) 00000100:00100000:0.0:1788359272.132063:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445334784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 358us (2903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.132071:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788359272.132204:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445334784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359272.132227:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359272.132257:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359272.133049:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445334912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.133105:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.133212:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.133313:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445334912 00000100:00100000:2.0:1788359272.133322:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445334912 00000100:00100000:2.0:1788359272.133682:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788359272.133694:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445334912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.133892:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445334912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.133901:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788359272.133983:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445334912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.134029:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.134086:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.141116:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.142362:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335040 00000100:00100000:0.0:1788359272.142379:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335040 00000100:00100000:0.0:1788359272.142459:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788359272.142471:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445335040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.142746:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445335040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.142755:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788359272.142845:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359272.143411:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10352:1875230445335168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359272.143468:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.143539:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.143642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335168 00000100:00100000:0.0:1788359272.143648:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335168 00000100:00100000:0.0:1788359272.143677:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788359272.143685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10352:x1875230445335168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.143802:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10352:x1875230445335168:12345-0@lo:502:llog_process_th.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.143810:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788359272.143820:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10352:1875230445335168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788359272.143845:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359272.143857:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359272.143860:0:10352:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788359272.143866:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788359272.143889:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10352:1875230445335296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359272.143924:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359272.143949:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.144000:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335296 00000100:00100000:0.0:1788359272.144005:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335296 00000100:00100000:0.0:1788359272.144034:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788359272.144040:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10352:x1875230445335296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.144116:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10352:x1875230445335296:12345-0@lo:502:llog_process_th.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.144124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788359272.144191:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10352:1875230445335296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788359272.144210:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359272.144215:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359272.144217:0:10352:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788359272.144220:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788359272.144666:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788359272.144692:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788359272.144705:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.144717:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359272.144748:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788359272.144751:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eae4e42000 from 48 10000000:01000000:0.0:1788359272.144755:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359272.144789:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.144797:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.144809:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.144825:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.144861:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.144896:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.145622:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335424 00000100:00100000:2.0:1788359272.145632:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335424 00000100:00100000:2.0:1788359272.145688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788359272.145698:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445335424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359272.145711:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359272.145731:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae4fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae4f4 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.145764:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae4f4 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.145792:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae4f4 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.145803:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40a00, rc 0) 00000100:00100000:2.0:1788359272.145870:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445335424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.145879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788359272.146050:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.146069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.146079:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.146152:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.146186:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.146225:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.146618:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335552 00000100:00100000:2.0:1788359272.146629:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335552 00000100:00100000:2.0:1788359272.146663:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788359272.146671:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445335552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.146835:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445335552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.146842:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788359272.147883:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.147947:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.148035:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.148045:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335680 00000100:00100000:1.0:1788359272.148052:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335680 00000100:00100000:0.0:1788359272.148068:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.148103:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788359272.148113:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445335680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.148249:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445335680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359272.148257:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788359272.148472:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445335680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.148960:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10353:1875230445335808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.149004:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.149037:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.149110:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335808 00000100:00100000:0.0:1788359272.149116:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335808 00000100:00100000:0.0:1788359272.149150:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788359272.149159:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10353:x1875230445335808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.149324:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10353:x1875230445335808:12345-0@lo:502:llog_process_th.0 Request processed in 165us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.149333:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788359272.149938:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10353:1875230445335808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.149996:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10353:1875230445335936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.150041:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.150071:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571240 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.150126:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445335936 00000100:00100000:0.0:1788359272.150132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445335936 00000100:00100000:0.0:1788359272.150168:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788359272.150176:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10353:x1875230445335936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.150440:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10353:x1875230445335936:12345-0@lo:502:llog_process_th.0 Request processed in 263us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.150448:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788359272.152713:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10353:1875230445335936:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788359272.152779:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788359272.153118:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788359272.153153:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788359272.153168:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153181:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359272.153193:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788359272.153196:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788359272.153216:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788359272.153270:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153280:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153291:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.153383:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.153461:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.153534:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336064 00000100:00100000:0.0:1788359272.153541:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336064 00000100:00100000:0.0:1788359272.153590:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788359272.153598:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445336064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.153614:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359272.153628:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b000/0x49dd053b5feae509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae502 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153657:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b000/0x49dd053b5feae509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae502 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153669:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14b000/0x49dd053b5feae509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae502 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153679:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b000, rc 0) 00000100:00100000:0.0:1788359272.153710:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.153716:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788359272.153771:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.153785:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.153799:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.153809:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359272.153869:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.153896:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.153917:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336192 00000100:00100000:0.0:1788359272.153921:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336192 00000100:00100000:0.0:1788359272.153942:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788359272.153947:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.154085:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.154092:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788359272.154111:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.154120:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.154146:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.154183:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.154199:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336320 00000100:00100000:0.0:1788359272.154202:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336320 00000100:00100000:0.0:1788359272.154218:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788359272.154223:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.156544:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2303us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.156579:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788359272.156678:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.156709:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359272.158594:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10354:1875230445336448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359272.158706:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359272.158766:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.159704:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336448 00000100:00100000:2.0:1788359272.159718:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336448 00000100:00100000:2.0:1788359272.159805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788359272.159817:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10354:x1875230445336448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.160039:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10354:x1875230445336448:12345-0@lo:502:llog_process_th.0 Request processed in 224us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.160048:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788359272.160275:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10354:1875230445336448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359272.160329:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359272.160341:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359272.160344:0:10354:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788359272.160352:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788359272.160394:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10354:1875230445336576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359272.160446:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359272.160492:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359272.161889:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336576 00000100:00100000:2.0:1788359272.161904:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336576 00000100:00100000:2.0:1788359272.161976:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788359272.161989:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10354:x1875230445336576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359272.162161:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10354:x1875230445336576:12345-0@lo:502:llog_process_th.0 Request processed in 174us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359272.162171:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788359272.162457:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10354:1875230445336576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359272.162510:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359272.162518:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359272.162520:0:10354:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788359272.162526:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788359272.162817:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1788359272.162847:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788359272.162860:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.162873:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359272.162884:0:6512:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788359272.162893:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0eaf5930000 from 1 10000000:01000000:2.0:1788359272.162897:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788359272.162939:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.162948:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.162958:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.162995:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.163039:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.163097:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359272.163426:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336704 00000100:00100000:0.0:1788359272.163434:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336704 00000100:00100000:0.0:1788359272.163480:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788359272.163490:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445336704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359272.163529:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359272.163547:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14ba00/0x49dd053b5feae517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae510 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.163575:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14ba00/0x49dd053b5feae517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae510 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.163587:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14ba00/0x49dd053b5feae517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae510 expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.163597:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14ba00, rc 0) 00000100:00100000:0.0:1788359272.163638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445336704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359272.163644:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788359272.165643:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359272.165678:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.165693:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359272.165828:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359272.165894:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359272.165929:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359272.166168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336832 00000100:00100000:1.0:1788359272.166193:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336832 00000100:00100000:1.0:1788359272.166266:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788359272.166277:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445336832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359272.167614:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445336832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1328us (1708us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788359272.167628:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788359272.168569:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445336832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788359272.168624:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788359272.168638:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359272.168652:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359272.829626:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359273.853316:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359274.688646:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359274.688682:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445336960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359274.688796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359274.688967:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445336960 00000100:00100000:1.0:1788359274.688976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445336960 00000100:00100000:1.0:1788359274.689053:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788359274.689065:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445336960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359274.689109:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359274.689179:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445336960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359274.689188:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788359274.689355:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445336960:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359274.876828:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359275.196883:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359275.196917:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445337088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359275.197022:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359275.197196:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337088 00000100:00100000:0.0:1788359275.197217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337088 00000100:00100000:0.0:1788359275.197775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788359275.197789:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445337088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359275.197838:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359275.197912:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445337088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359275.197921:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788359275.198011:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445337088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359275.455848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359275.459894:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420112896 00000100:00100000:1.0:1788359275.460809:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420112896 00000100:00100000:1.0:1788359275.461068:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 241 00000100:00100000:1.0:1788359275.461082:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+8:6175:x1875230420112896:12345-192.168.202.52@tcp:101: 00010000:00010000:1.0:1788359275.461106:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359275.461132:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d73 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359275.461172:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d73 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359275.461186:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d73 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359275.461246:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056a00, rc 0) 00000100:00100000:1.0:1788359275.461345:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420112896:12345-192.168.202.52@tcp:101: Request processed in 266us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359275.461353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 241 00000100:00100000:3.0:1788359275.465435:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359275.478429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113024 00000100:00100000:0.0:1788359275.478454:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113024 00000100:00100000:0.0:1788359275.478577:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 242 00000100:00100000:0.0:1788359275.478591:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420113024:12345-192.168.202.52@tcp:501: 00000100:00100000:0.0:1788359275.478855:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420113024:12345-192.168.202.52@tcp:501: Request processed in 266us (13436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359275.478863:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 242 00000100:00100000:3.0:1788359275.483404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359275.483530:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113152 00000100:00100000:0.0:1788359275.483544:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113152 00000100:00100000:0.0:1788359275.483603:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 243 00000100:00100000:0.0:1788359275.483613:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420113152:12345-192.168.202.52@tcp:503: 00000100:00100000:0.0:1788359275.483829:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420113152:12345-192.168.202.52@tcp:503: Request processed in 215us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359275.483839:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 243 00000100:00100000:3.0:1788359275.497589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359275.497646:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113280 00000100:00100000:0.0:1788359275.497680:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113280 00000100:00100000:0.0:1788359275.497800:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 244 00000100:00100000:0.0:1788359275.497811:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6675:x1875230420113280:12345-192.168.202.52@tcp:502: 00000100:00100000:0.0:1788359275.498001:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6675:x1875230420113280:12345-192.168.202.52@tcp:502: Request processed in 192us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359275.498009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 244 00000100:00100000:3.0:1788359275.501229:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359275.501338:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113408 00000100:00100000:2.0:1788359275.501354:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113408 00000100:00100000:2.0:1788359275.501671:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 245 00000100:00100000:2.0:1788359275.501701:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6675:x1875230420113408:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359275.501891:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6675:x1875230420113408:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 193us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359275.501901:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 245 00000100:00100000:1.0:1788359275.506125:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359275.506583:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113536 00000100:00100000:0.0:1788359275.506596:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113536 00000100:00100000:0.0:1788359275.506667:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 246 00000100:00100000:0.0:1788359275.506679:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420113536:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359275.506702:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359275.506726:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d7a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359275.506765:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d7a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359275.506780:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d7a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359275.506791:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b400, rc 0) 00000100:00100000:0.0:1788359275.506868:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420113536:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 190us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359275.506875:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 246 00000100:00100000:1.0:1788359275.511172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359275.511344:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113664 00000100:00100000:2.0:1788359275.511358:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113664 00000100:00100000:2.0:1788359275.511706:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 247 00000100:00100000:2.0:1788359275.511719:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420113664:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359275.511934:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420113664:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 216us (779us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788359275.511944:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 247 00010000:00010000:3.0:1788359275.903403:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359276.503761:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359276.510023:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113792 00000100:00100000:2.0:1788359276.510046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113792 00000100:00100000:2.0:1788359276.510152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:2.0:1788359276.510165:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420113792:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359276.517221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420113792:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 7028us (13447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359276.517243:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:1.0:1788359276.517543:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359276.517731:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359276.517762:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114176 00000100:00100000:1.0:1788359276.517775:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114176 00000100:00100000:1.0:1788359276.517850:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:1.0:1788359276.517863:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420114176:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359276.518520:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420114176:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 630us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359276.518532:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00080000:1.0:1788359276.518567:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359276.518614:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359276.518683:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359276.518786:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420113920 00000100:00100000:1.0:1788359276.518794:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420113920 00000100:00100000:1.0:1788359276.518841:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114048 00000100:00100000:1.0:1788359276.518844:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114048 00000100:00100000:1.0:1788359276.518868:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:1.0:1788359276.518876:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420113920:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359276.522577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420113920:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 3681us (5016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359276.522599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:1.0:1788359276.522656:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:1.0:1788359276.522676:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420114048:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359276.522706:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420114048:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 41us (4093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359276.522712:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00080000:1.0:1788359276.522747:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359276.522754:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359276.523735:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114304 00000100:00100000:2.0:1788359276.523755:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114304 00000100:00100000:2.0:1788359276.523851:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:2.0:1788359276.523863:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420114304:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359276.523943:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420114304:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 83us (5258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359276.523951:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00080000:1.0:1788359276.524213:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788359276.924869:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788359277.174422:0:10392:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb626cfb0 20000000:00000080:0.0:1788359277.174448:0:10392:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0eb009f5c00 uarg=0000000000000000 20000000:01000000:0.0:1788359277.174535:0:10392:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788359277.174543:0:10392:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788359277.174555:0:10392:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788359277.177358:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788359277.177712:0:10392:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788359277.184827:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788359277.184875:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788359277.184891:0:10392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788359277.184910:0:10392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788359277.184937:0:10392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.184959:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae16d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.184968:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.184976:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae223 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.184984:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae349 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.184995:0:10392:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185005:0:10392:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185060:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185079:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 9 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.185125:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337216:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359277.185334:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185344:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 23 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.185356:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7532300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337344:0@lo:104: 00000100:00100000:0.0:1788359277.185409:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359277.185458:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185466:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 23 pid: 6509 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.185475:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337472:0@lo:104: 00000100:00100000:0.0:1788359277.185541:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359277.185575:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185583:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 23 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.185592:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337600:0@lo:104: 00010000:00010000:0.0:1788359277.185616:0:10392:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.185623:0:10392:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 23 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.185640:0:10392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7532a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337728:0@lo:104: 00000100:00100000:0.0:1788359277.185663:0:10392:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359277.185834:0:8447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788359277.185858:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.185889:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.185900:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337344 00000100:00100000:2.0:1788359277.185909:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337344 00000100:00100000:2.0:1788359277.185956:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337472 00000100:00100000:2.0:1788359277.185959:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337472 00000100:00100000:2.0:1788359277.185969:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337600 00000100:00100000:2.0:1788359277.185971:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337600 00000100:00100000:2.0:1788359277.185979:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337728 00000100:00100000:2.0:1788359277.185981:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337728 00000100:00100000:2.0:1788359277.185995:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359277.186005:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:10392:x1875230445337344:12345-0@lo:104: 00010000:00010000:2.0:1788359277.186021:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186081:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788359277.186088:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:10392:x1875230445337344:12345-0@lo:104: Request processed in 85us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.186096:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359277.186114:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359277.186119:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:10392:x1875230445337472:12345-0@lo:104: 00010000:00010000:2.0:1788359277.186126:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186161:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788359277.186167:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:10392:x1875230445337472:12345-0@lo:104: Request processed in 48us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.186173:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359277.186230:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788359277.186246:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:10392:x1875230445337600:12345-0@lo:104: 00010000:00010000:2.0:1788359277.186254:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186285:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788359277.186290:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:10392:x1875230445337600:12345-0@lo:104: Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.186296:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788359277.186309:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788359277.186314:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:10392:x1875230445337728:12345-0@lo:104: 00010000:00010000:2.0:1788359277.186321:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186346:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788359277.186351:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:10392:x1875230445337728:12345-0@lo:104: Request processed in 37us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.186356:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788359277.186376:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788359277.186383:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186390:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359277.186394:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186403:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359277.186410:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359277.186423:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359277.186455:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186461:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359277.186485:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186524:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae350 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186541:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788359277.186544:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186550:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359277.186553:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186560:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359277.186566:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359277.186572:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359277.186585:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186590:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359277.186614:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186621:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae223 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae22a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186633:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788359277.186636:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186642:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031a00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359277.186645:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186651:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359277.186658:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359277.186664:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359277.186677:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.186683:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359277.186816:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788359277.186839:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359277.186855:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445337856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359277.186899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359277.186938:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359277.186948:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445337984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359277.186972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359277.187000:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337856 00000100:00100000:3.0:1788359277.187006:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337856 00010000:00010000:3.0:1788359277.187040:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 24 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359277.187067:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445337984 00000100:00100000:3.0:1788359277.187070:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445337984 00010000:00010000:3.0:1788359277.187084:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 25 pid: 6509 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359277.187104:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788359277.187112:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3642:x1875230445337856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359277.187126:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359277.187133:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 25 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187144:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 25 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187165:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359277.187212:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3642:x1875230445337856:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359277.187220:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788359277.187234:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788359277.187241:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445337984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359277.187249:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359277.187253:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 24 pid: 6509 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187262:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 24 pid: 6509 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187283:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359277.187313:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445337984:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359277.187319:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788359277.187371:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445337984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359277.187399:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445337856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359277.187648:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359277.187655:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187664:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359277.187667:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.187676:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359277.187683:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.187809:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.187817:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0031a00/0x49dd053b5feae1c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae1c8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.187829:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359277.187838:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359277.187840:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359277.187852:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359277.187864:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445338112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359277.187899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.187935:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338112 00000100:00100000:2.0:1788359277.187939:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338112 00010000:00010000:2.0:1788359277.187958:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 24 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359277.187979:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359277.187985:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445338112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359277.187995:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359277.187999:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 24 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.188008:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 24 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359277.188034:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359277.188064:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445338112:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.188070:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359277.188097:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445338112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359277.188245:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b600/0x49dd053b5feae350 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae349 expref: 23 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.188258:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7532300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337344:0@lo:104: 00010000:00010000:0.0:1788359277.188270:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eadbea4800/0x49dd053b5feae22a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae223 expref: 22 pid: 6509 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.188281:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337472:0@lo:104: 00010000:00010000:0.0:1788359277.188291:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb0217e000/0x49dd053b5feae1c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae1c1 expref: 21 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.188300:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337600:0@lo:104: 00000100:00100000:0.0:1788359277.188310:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7532a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337728:0@lo:104: 10000000:01000000:3.0:1788359277.188352:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788359277.188427:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.188434:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359277.188458:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.188478:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056600/0x49dd053b5feae16d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae174 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.188521:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359277.188524:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359277.188526:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359277.188532:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359277.188533:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359277.190019:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445338240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359277.190097:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359277.190217:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338240 00000100:00100000:3.0:1788359277.190228:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338240 00010000:00010000:3.0:1788359277.190270:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 21 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359277.190316:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359277.190329:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2509850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3642:x1875230445338240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359277.190344:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359277.190350:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 21 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.190361:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 21 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.190379:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb0217f400/0x49dd053b5feae174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae16d expref: 21 pid: 6510 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.190398:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359277.190455:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2509850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3642:x1875230445338240:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359277.190463:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788359277.191349:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445338240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359277.194385:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359277.194770:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114432 00000100:00100000:3.0:1788359277.194784:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114432 00010000:00010000:3.0:1788359277.194832:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 10 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359277.194886:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:3.0:1788359277.194897:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420114432:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359277.194916:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359277.194923:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 10 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.194939:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 10 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.194979:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.194990:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195009:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195015:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195022:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195029:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195054:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359277.195059:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195067:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195076:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359277.195087:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359277.195388:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420114432:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 490us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359277.195398:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 39 00010000:00010000:0.0:1788359277.196313:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d3b expref: 9 pid: 6509 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359277.196338:0:10392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10392:1875230445337216:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359277.196383:0:10392:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.196393:0:10392:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.196399:0:10392:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359277.196427:0:10392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae52c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359277.245002:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445338368:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245111:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245136:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338368 00000100:00100000:1.0:1788359277.245144:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338368 00000100:00100000:2.0:1788359277.245153:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445338880:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245176:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245208:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445339392:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245221:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338880 00000100:00100000:1.0:1788359277.245224:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338880 00000100:00100000:2.0:1788359277.245230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245254:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339392 00000100:00100000:1.0:1788359277.245257:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339392 00000100:00100000:2.0:1788359277.245265:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359277.245276:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788359277.245285:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445338368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245312:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359277.245317:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445338752:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245343:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245344:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445338368:12345-0@lo:400:kworker.0 Request processed in 59us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359277.245351:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788359277.245359:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339264:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788359277.245378:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445338880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245382:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245398:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339776:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245414:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445338880:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.245416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245420:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788359277.245432:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788359277.245438:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445339392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245453:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445338368:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245464:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445339392:12345-0@lo:400:kworker.0 Request processed in 26us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.245465:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445338880:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245470:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788359277.245473:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445339392:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245527:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445338496:0@lo:400:kworker.0 00000100:00080000:1.0:1788359277.245528:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359277.245546:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339264 00000100:00100000:1.0:1788359277.245550:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339264 00000100:00100000:2.0:1788359277.245552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245570:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445339008:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245579:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339776 00000100:00100000:1.0:1788359277.245582:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339776 00000100:00100000:2.0:1788359277.245591:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245602:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359277.245605:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445339520:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.245608:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445339264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245635:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359277.245644:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445339264:12345-0@lo:400:kworker.0 Request processed in 36us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.245650:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445340032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359277.245651:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788359277.245662:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788359277.245668:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445339776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245691:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359277.245698:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445338624:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245738:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245774:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245790:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445339648:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.245811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.245838:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339904 00000100:00100000:2.0:1788359277.245843:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339904 00000100:00100000:2.0:1788359277.245866:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340032 00000100:00100000:2.0:1788359277.245868:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340032 00000100:00100000:2.0:1788359277.245886:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359277.245892:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445339904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359277.245918:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359277.245951:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445339904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.245958:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359277.245970:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359277.245977:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445340032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359277.245986:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359277.246014:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445340032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246019:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359277.246046:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338752 00000100:00100000:2.0:1788359277.246050:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338752 00000100:00100000:2.0:1788359277.246075:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338496 00000100:00100000:2.0:1788359277.246079:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338496 00000100:00100000:2.0:1788359277.246092:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788359277.246097:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445338752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246134:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445338752:12345-0@lo:400:kworker.0 Request processed in 36us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246140:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788359277.246150:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788359277.246155:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445338496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246179:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445338496:12345-0@lo:400:kworker.0 Request processed in 24us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246329:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788359277.246356:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339008 00000100:00100000:2.0:1788359277.246359:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339008 00000100:00100000:2.0:1788359277.246385:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339520 00000100:00100000:2.0:1788359277.246388:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339520 00000100:00100000:2.0:1788359277.246405:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445338624 00000100:00100000:2.0:1788359277.246408:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445338624 00000100:00100000:2.0:1788359277.246421:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788359277.246426:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445339008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246458:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445339008:12345-0@lo:400:kworker.0 Request processed in 31us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246465:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788359277.246477:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788359277.246483:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445339520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246538:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445339520:12345-0@lo:400:kworker.0 Request processed in 56us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246552:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788359277.246564:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788359277.246569:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246602:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445338624:12345-0@lo:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.246608:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788359277.246650:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445338624:0@lo:400:kworker.0 00000100:00100000:2.0:1788359277.246661:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445338496:0@lo:400:kworker.0 00010000:00080000:2.0:1788359277.246676:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6caca80 x1875230445339008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359277.246687:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445339008:0@lo:400:kworker.0 00010000:00080000:2.0:1788359277.246698:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a10e00 x1875230445339520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359277.246706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445339520:0@lo:400:kworker.0 00010000:00080000:2.0:1788359277.246717:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7526300 x1875230445340032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359277.246732:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445340032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359277.247613:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445340160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359277.247680:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359277.247736:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340160 00000100:00100000:0.0:1788359277.247743:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340160 00000100:00100000:0.0:1788359277.247794:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788359277.247802:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445340160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359277.247830:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359277.247871:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445340160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359277.247878:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788359277.247922:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7531500 x1875230445340160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359277.247941:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445340160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359277.248885:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339136 00000100:00100000:1.0:1788359277.248896:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339136 00000100:00100000:1.0:1788359277.248929:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445339648 00000100:00100000:1.0:1788359277.248933:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445339648 00000100:00100000:1.0:1788359277.248948:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359277.248957:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445339136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.249034:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445339136:12345-0@lo:400:kworker.0 Request processed in 78us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359277.249063:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359277.249080:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359277.249087:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445339648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.249119:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445339648:12345-0@lo:400:kworker.0 Request processed in 34us (3308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359277.249125:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788359277.249279:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359277.249286:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359277.249289:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359277.249341:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445338752:0@lo:400:kworker.0 00010000:00080000:1.0:1788359277.249362:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bb100 x1875230445339264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359277.249374:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339264:0@lo:400:kworker.0 00010000:00080000:1.0:1788359277.249390:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7525180 x1875230445339904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788359277.249399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b2300 x1875230445339136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359277.249406:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359277.249410:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445339136:0@lo:400:kworker.0 00010000:00080000:2.0:1788359277.249421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a12680 x1875230445339648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359277.249438:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445339648:0@lo:400:kworker.0 00000100:00100000:1.0:1788359277.249457:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445339776:12345-0@lo:400:kworker.0 Request processed in 3788us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359277.249464:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788359277.249515:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a13100 x1875230445339776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359277.249523:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445339776:0@lo:400:kworker.0 00000100:00100000:0.0:1788359277.250676:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359277.250698:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445340288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359277.250767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359277.250866:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340288 00000100:00100000:2.0:1788359277.250876:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340288 00000100:00100000:2.0:1788359277.251078:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788359277.251090:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445340288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359277.251117:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359277.251170:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445340288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359277.251178:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788359277.251257:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a12d80 x1875230445340288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359277.251277:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445340288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788359277.953933:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788359278.463383:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788359278.463408:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaff1c4000 from 4 10000000:01000000:0.0:1788359278.463413:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359278.463463:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359278.463476:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359278.463487:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359278.463532:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359278.463604:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359278.463654:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.468433:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340416 00000100:00100000:2.0:1788359278.468449:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340416 00000100:00100000:2.0:1788359278.468521:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788359278.468531:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445340416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.468548:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359278.468568:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae533 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.468596:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.468608:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.468618:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41200, rc 0) 00000100:00100000:2.0:1788359278.468717:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445340416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.468724:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788359278.468796:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.468813:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.468823:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.468901:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.468935:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.468964:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccff3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.468978:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340544 00000100:00100000:2.0:1788359278.468983:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340544 00000100:00100000:2.0:1788359278.469006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788359278.469011:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445340544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.469121:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445340544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.469128:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788359278.469157:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.469197:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.469238:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.469254:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccff3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.469266:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340672 00000100:00100000:2.0:1788359278.469269:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340672 00000100:00100000:2.0:1788359278.469290:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788359278.469296:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445340672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.469377:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445340672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.469389:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788359278.469422:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445340672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.469598:0:10449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10449:1875230445340800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.469628:0:10449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.469643:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340800 00000100:00100000:2.0:1788359278.469646:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340800 00000100:00100000:2.0:1788359278.469663:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788359278.469668:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10449:x1875230445340800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.469727:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10449:x1875230445340800:12345-0@lo:502:llog_process_th.0 Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.469733:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788359278.469756:0:10449:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccff3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.469766:0:10449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10449:1875230445340800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359278.469786:0:10449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359278.469795:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359278.469797:0:10449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788359278.469804:0:10449:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaff1c4000 00000020:00000080:2.0:1788359278.469807:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359278.469878:0:10449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10449:1875230445340928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.469907:0:10449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.469922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445340928 00000100:00100000:2.0:1788359278.469925:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445340928 00000100:00100000:2.0:1788359278.469941:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788359278.469946:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10449:x1875230445340928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.469995:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:10449:x1875230445340928:12345-0@lo:502:llog_process_th.0 Request processed in 48us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.470006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788359278.470028:0:10449:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.470038:0:10449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10449:1875230445340928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359278.470052:0:10449:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359278.470056:0:10449:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359278.470057:0:10449:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788359278.470061:0:10449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788359278.470104:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788359278.470121:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359278.470128:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470137:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359278.470146:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359278.470149:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6d76800 from 4 10000000:01000000:2.0:1788359278.470151:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359278.470171:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470191:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470199:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.470212:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470237:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.470257:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.470268:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341056 00000100:00100000:2.0:1788359278.470271:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341056 00000100:00100000:2.0:1788359278.470292:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788359278.470298:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445341056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.470305:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359278.470316:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae541 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470332:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae541 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470341:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae541 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470349:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac40c00, rc 0) 00000100:00100000:2.0:1788359278.470372:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.470378:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788359278.470403:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.470413:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.470421:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.470454:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470474:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.470490:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.470517:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341184 00000100:00100000:2.0:1788359278.470520:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341184 00000100:00100000:2.0:1788359278.470537:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788359278.470542:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470602:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.470608:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788359278.470630:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470649:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470676:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.470686:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf58c0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.470695:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341312 00000100:00100000:2.0:1788359278.470698:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341312 00000100:00100000:2.0:1788359278.470714:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788359278.470718:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.470771:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.470777:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788359278.470813:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359278.501697:0:10450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10450:1875230445341440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359278.502903:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359278.502950:0:10450:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.505161:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341440 00000100:00100000:2.0:1788359278.505201:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341440 00000100:00100000:2.0:1788359278.505260:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788359278.505269:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10450:x1875230445341440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.505415:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10450:x1875230445341440:12345-0@lo:502:llog_process_th.0 Request processed in 147us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.505429:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788359278.505490:0:10450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10450:1875230445341440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359278.505540:0:10450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359278.505549:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359278.505551:0:10450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788359278.505557:0:10450:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaf6d76800 00000020:00000080:2.0:1788359278.505560:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788359278.509968:0:10450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10450:1875230445341568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359278.510065:0:10450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359278.510111:0:10450:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.512352:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341568 00000100:00100000:2.0:1788359278.512365:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341568 00000100:00100000:2.0:1788359278.512420:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788359278.512430:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10450:x1875230445341568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.512604:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:10450:x1875230445341568:12345-0@lo:502:llog_process_th.0 Request processed in 175us (2539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.512613:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788359278.513269:0:10450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10450:1875230445341568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359278.513304:0:10450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359278.513313:0:10450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359278.513315:0:10450:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788359278.513319:0:10450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788359278.517867:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788359278.517910:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359278.517922:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.517936:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359278.517946:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359278.517949:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6cef800 from 4 10000000:01000000:2.0:1788359278.517951:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359278.517999:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518015:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518026:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.518051:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.518109:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.518146:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.518285:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341696 00000100:00100000:2.0:1788359278.518292:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341696 00000100:00100000:2.0:1788359278.518331:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788359278.518339:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445341696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.518353:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359278.518364:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae54f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518386:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518397:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518405:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb800, rc 0) 00000100:00100000:2.0:1788359278.518437:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445341696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.518443:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788359278.518488:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.518514:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.518523:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.518573:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.518596:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.518608:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.518618:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341824 00000100:00100000:2.0:1788359278.518621:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341824 00000100:00100000:2.0:1788359278.518636:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788359278.518641:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445341824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.520883:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445341824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2233us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.520898:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788359278.520975:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.521029:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.521077:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.521107:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.521122:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445341952 00000100:00100000:2.0:1788359278.521128:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445341952 00000100:00100000:2.0:1788359278.521163:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788359278.521180:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445341952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.521288:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445341952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.521301:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788359278.521342:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445341952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.521575:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10455:1875230445342080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.521608:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.521627:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342080 00000100:00100000:2.0:1788359278.521630:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342080 00000100:00100000:2.0:1788359278.521651:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788359278.521656:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10455:x1875230445342080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.524343:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10455:x1875230445342080:12345-0@lo:502:llog_process_th.0 Request processed in 2676us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.524357:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788359278.524434:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.524459:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10455:1875230445342080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359278.524506:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359278.524516:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359278.524519:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788359278.524528:0:10455:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaf6cef800 00000020:00000080:2.0:1788359278.524530:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359278.526602:0:10455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10455:1875230445342208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.527834:0:10455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.527884:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342208 00000100:00100000:2.0:1788359278.527891:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342208 00000100:00100000:2.0:1788359278.527936:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788359278.527945:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10455:x1875230445342208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359278.528082:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:10455:x1875230445342208:12345-0@lo:502:llog_process_th.0 Request processed in 138us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.528097:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788359278.528150:0:10455:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.531417:0:10455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10455:1875230445342208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359278.531465:0:10455:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359278.531474:0:10455:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359278.531476:0:10455:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788359278.531480:0:10455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788359278.531568:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788359278.531594:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359278.531604:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.531616:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359278.531627:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359278.531630:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eae4e42000 from 4 10000000:01000000:2.0:1788359278.531633:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359278.531667:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.531854:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.531864:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.531888:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.531964:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.532013:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.532036:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342336 00000100:00100000:2.0:1788359278.532045:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342336 00000100:00100000:2.0:1788359278.532095:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788359278.532104:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445342336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.532120:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359278.532132:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae55d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.532162:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae55d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.532184:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae55d expref: 24 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.532194:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eae00, rc 0) 00000100:00100000:2.0:1788359278.532235:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445342336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.532242:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788359278.532291:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359278.532304:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359278.532313:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359278.532366:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.532392:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.532415:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.532428:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342464 00000100:00100000:2.0:1788359278.532431:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342464 00000100:00100000:2.0:1788359278.532454:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788359278.532461:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445342464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.532587:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445342464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.532594:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788359278.532626:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.532672:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.536943:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359278.537004:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359278.537031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342592 00000100:00100000:2.0:1788359278.537040:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342592 00000100:00100000:2.0:1788359278.537101:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788359278.537111:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445342592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359278.537267:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445342592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359278.537275:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788359278.537344:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445342592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359278.554043:0:10458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10458:1875230445342720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359278.554143:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359278.554209:0:10458:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359278.554899:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342720 00000100:00100000:0.0:1788359278.554908:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342720 00000100:00100000:0.0:1788359278.554957:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788359278.554966:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:10458:x1875230445342720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359278.556073:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:10458:x1875230445342720:12345-0@lo:502:llog_process_th.0 Request processed in 1104us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359278.556084:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788359278.569684:0:10458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10458:1875230445342720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359278.569941:0:10458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359278.569955:0:10458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359278.569958:0:10458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788359278.569967:0:10458:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eae4e42000 00000020:00000080:1.0:1788359278.569970:0:10458:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788359278.570323:0:10458:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10458:1875230445342848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359278.570398:0:10458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359278.570441:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342848 00000100:00100000:1.0:1788359278.570448:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342848 00000100:00100000:1.0:1788359278.570930:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788359278.570942:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:10458:x1875230445342848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359278.571076:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:10458:x1875230445342848:12345-0@lo:502:llog_process_th.0 Request processed in 136us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359278.571083:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788359278.571136:0:10458:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac5287600 going to sleep for 11 seconds 00000100:00100000:1.0:1788359278.571155:0:10458:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:10458:1875230445342848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788359278.571189:0:10458:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359278.571194:0:10458:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359278.571202:0:10458:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788359278.571207:0:10458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788359278.573469:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788359278.573633:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359278.573646:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359278.573670:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359278.589159:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359278.598094:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114560 00000100:00100000:3.0:1788359278.598115:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114560 00000100:00100000:3.0:1788359278.598196:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 269 00000100:00100000:3.0:1788359278.598214:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:6175:x1875230420114560:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359278.598233:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359278.598258:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d81 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359278.598296:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359278.598329:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359278.598345:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031800, rc 0) 00000100:00100000:3.0:1788359278.598435:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420114560:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 223us (9286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359278.598450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 269 00000100:00100000:3.0:1788359278.609567:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359278.609602:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114688 00000100:00100000:3.0:1788359278.609612:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114688 00000100:00100000:3.0:1788359278.609657:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 270 00000100:00100000:3.0:1788359278.609665:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420114688:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359278.613666:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420114688:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 3994us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359278.613692:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 270 00000100:00100000:3.0:1788359278.616002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359278.616042:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114816 00000100:00100000:3.0:1788359278.616052:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114816 00000100:00100000:3.0:1788359278.616105:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 271 00000100:00100000:3.0:1788359278.616115:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420114816:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359278.616265:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6175:x1875230420114816:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 152us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359278.616273:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 271 00000100:00100000:3.0:1788359278.634078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359278.634112:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420114944 00000100:00100000:3.0:1788359278.634130:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420114944 00000100:00100000:3.0:1788359278.634189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 272 00000100:00100000:3.0:1788359278.634200:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6739:x1875230420114944:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788359278.634333:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6739:x1875230420114944:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 135us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359278.634342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 272 00000100:00100000:0.0:1788359278.644992:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359278.645086:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115072 00000100:00100000:3.0:1788359278.645096:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115072 00000100:00100000:3.0:1788359278.645155:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 273 00000100:00100000:3.0:1788359278.645165:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6739:x1875230420115072:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788359278.645322:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:6739:x1875230420115072:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 158us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359278.645331:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 273 00010000:00010000:1.0:1788359278.973012:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359279.805022:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359279.805048:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445342976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788359279.805118:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359279.805242:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445342976 00000100:00100000:2.0:1788359279.805251:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445342976 00000100:00100000:2.0:1788359279.805303:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788359279.805324:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445342976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359279.805362:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359279.805425:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445342976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359279.805444:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788359279.805694:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445342976:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788359279.996683:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359280.318817:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788359280.318851:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445343104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359280.318942:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359280.319022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343104 00000100:00100000:1.0:1788359280.319032:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343104 00000100:00100000:1.0:1788359280.319092:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788359280.319100:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445343104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359280.319145:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788359280.319588:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445343104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 486us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359280.319597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788359280.319717:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445343104:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359281.023406:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359281.595794:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359281.595831:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359281.595858:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359281.595883:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359281.595905:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359281.595931:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115584 00000100:00100000:1.0:1788359281.595940:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115584 00000100:00100000:1.0:1788359281.595998:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115712 00000100:00100000:1.0:1788359281.596127:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115712 00000100:00100000:1.0:1788359281.596173:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:1.0:1788359281.596213:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115584:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359281.596318:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115584:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 109us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359281.596326:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:1.0:1788359281.596347:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:1.0:1788359281.596354:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115712:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359281.596379:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115712:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359281.596385:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00080000:1.0:1788359281.596406:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359281.596410:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359281.597043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115200 00000100:00100000:3.0:1788359281.597050:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115200 00000100:00100000:3.0:1788359281.597094:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 274 00000100:00100000:3.0:1788359281.597101:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2405:x1875230420115200:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359281.597154:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2405:x1875230420115200:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 41us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359281.597162:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 274 00000100:00100000:2.0:1788359281.597191:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115328 00000100:00100000:2.0:1788359281.597199:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115328 00000100:00100000:2.0:1788359281.597378:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115456 00000100:00100000:2.0:1788359281.597383:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115456 00000100:00100000:1.0:1788359281.597657:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:1.0:1788359281.597667:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420115328:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359281.597710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420115328:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 46us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359281.597717:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:1.0:1788359281.597733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00100000:1.0:1788359281.597740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115456:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359281.597768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420115456:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359281.597774:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00080000:2.0:1788359281.599624:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359281.599634:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788359282.045133:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359282.364723:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359282.364748:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445343232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359282.364815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359282.364906:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343232 00000100:00100000:1.0:1788359282.364914:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343232 00000100:00100000:1.0:1788359282.364972:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359282.364984:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445343232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359282.365014:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359282.365058:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445343232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359282.365065:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788359282.365085:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788359282.365115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524e00 x1875230445343232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359282.365143:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445343232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359282.365700:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359282.365712:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445343360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359282.365747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359282.365783:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343360 00000100:00100000:1.0:1788359282.365787:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343360 00000100:00100000:1.0:1788359282.365822:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788359282.365830:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445343360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359282.365845:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359282.365877:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445343360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359282.365883:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788359282.365898:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788359282.365914:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524e00 x1875230445343360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359282.365928:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445343360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359282.366244:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359282.366255:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445343488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359282.366289:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.366323:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343488 00000100:00100000:2.0:1788359282.366327:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343488 00000100:00100000:2.0:1788359282.366359:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359282.366366:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445343488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359282.366384:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359282.366418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445343488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359282.366423:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788359282.366439:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788359282.366458:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c62e1f80 x1875230445343488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359282.366470:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445343488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359282.366841:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359282.366851:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445343616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359282.366882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359282.366947:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343616 00000100:00100000:1.0:1788359282.366952:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343616 00000100:00100000:1.0:1788359282.366986:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788359282.366991:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445343616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359282.367002:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359282.367033:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445343616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359282.367040:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788359282.367092:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788359282.367113:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524e00 x1875230445343616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359282.367149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445343616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359282.368354:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445343744:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368409:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.368442:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445344256:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368467:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.368484:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445344768:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.368566:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788359282.368572:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445344128:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.368612:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445344640:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368633:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359282.368662:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344768 00000100:00100000:2.0:1788359282.368668:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344768 00000100:00100000:2.0:1788359282.368710:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344128 00000100:00100000:2.0:1788359282.368714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344128 00000100:00100000:2.0:1788359282.368731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344640 00000100:00100000:2.0:1788359282.368734:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344640 00000100:00100000:2.0:1788359282.368751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788359282.368759:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445344768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445344768:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359282.368814:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788359282.368828:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788359282.368834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445344128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368873:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445344128:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359282.368879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788359282.368891:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788359282.368897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445344640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445344640:12345-0@lo:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359282.368928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788359282.368958:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359282.368961:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359282.368988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445344128:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.368997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445344640:0@lo:400:kworker.0 00010000:00080000:2.0:1788359282.369008:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7525f80 x1875230445344768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359282.369018:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445344768:0@lo:400:kworker.0 00000100:00100000:3.0:1788359282.369112:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344256 00000100:00100000:3.0:1788359282.369116:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344256 00000100:00100000:3.0:1788359282.369164:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359282.369172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445344256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359282.369239:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445344256:12345-0@lo:400:kworker.0 Request processed in 68us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359282.369252:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359282.369283:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445344256:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343744 00000100:00100000:0.0:1788359282.370386:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343744 00000100:00100000:0.0:1788359282.370423:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788359282.370431:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445343744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370523:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445343744:12345-0@lo:400:kworker.0 Request processed in 92us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359282.370530:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788359282.370567:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445343872:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370598:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359282.370621:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445344384:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370644:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359282.370661:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788359282.370667:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445344000:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359282.370705:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445344512:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359282.370760:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344000 00000100:00100000:0.0:1788359282.370764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344000 00000100:00100000:0.0:1788359282.370789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788359282.370795:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445344000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370831:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445344000:12345-0@lo:400:kworker.0 Request processed in 36us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359282.370837:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788359282.370857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445343872 00000100:00100000:0.0:1788359282.370860:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445343872 00000100:00100000:0.0:1788359282.370881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344384 00000100:00100000:0.0:1788359282.370884:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344384 00000100:00100000:0.0:1788359282.370911:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344512 00000100:00100000:0.0:1788359282.370914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344512 00000100:00100000:0.0:1788359282.370930:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788359282.370935:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445343872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.370963:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445343872:12345-0@lo:400:kworker.0 Request processed in 28us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359282.370969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788359282.370982:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788359282.370987:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445344384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.371012:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445344384:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359282.371017:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788359282.371028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788359282.371033:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445344512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.371058:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445344512:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359282.371075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788359282.371098:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359282.371101:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359282.371123:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445344000:0@lo:400:kworker.0 00010000:00080000:0.0:1788359282.371147:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7525500 x1875230445344512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359282.371157:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445344512:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.371176:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445343872:0@lo:400:kworker.0 00000100:00100000:0.0:1788359282.371184:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445344384:0@lo:400:kworker.0 00000100:00100000:2.0:1788359282.372576:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445343744:0@lo:400:kworker.0 00010000:00010000:3.0:1788359283.072776:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788359283.102719:0:10694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788359284.094421:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359284.930442:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445344896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359284.930648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359284.936619:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445344896 00000100:00100000:3.0:1788359284.936705:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445344896 00000100:00100000:3.0:1788359284.936828:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788359284.936840:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445344896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359284.936881:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359284.936972:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445344896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359284.936978:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788359284.937048:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445344896:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359285.121711:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359285.436909:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359285.436936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359285.437006:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359285.443245:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345024 00000100:00100000:1.0:1788359285.443260:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345024 00000100:00100000:1.0:1788359285.443368:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788359285.443379:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359285.443417:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788359285.443540:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (6532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359285.443547:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788359285.443652:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788359286.140646:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359286.730210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359286.730255:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359286.730273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359286.730290:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359286.730329:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359286.730354:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116224 00000100:00100000:1.0:1788359286.730363:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116224 00000100:00100000:1.0:1788359286.730415:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116352 00000100:00100000:1.0:1788359286.730418:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116352 00000100:00100000:1.0:1788359286.730440:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:1.0:1788359286.730449:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2401:x1875230420116224:12345-192.168.202.52@tcp:9:kworker.0 00000020:00000080:1.0:1788359286.730518:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae47d 00000100:00080000:1.0:1788359286.730531:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7416000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359286.730578:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788359286.730752:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+2:2401:x1875230420116224:12345-192.168.202.52@tcp:9:kworker.0 Request processed in 303us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359286.730762:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:1.0:1788359286.730778:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:1.0:1788359286.730786:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2401:x1875230420116352:12345-192.168.202.52@tcp:9:kworker.0 00000020:00000080:1.0:1788359286.730799:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae484 00000100:00080000:1.0:1788359286.730804:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c745d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359286.730822:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788359286.730891:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+2:2401:x1875230420116352:12345-192.168.202.52@tcp:9:kworker.0 Request processed in 106us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359286.730898:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00010000:00010000:1.0:1788359286.730976:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359286.731315:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115840 00000100:00100000:0.0:1788359286.731320:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115840 00000100:00100000:0.0:1788359286.731359:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 276 00000100:00100000:0.0:1788359286.731367:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420115840:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359286.731403:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420115840:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 37us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359286.731409:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 276 00000100:00100000:0.0:1788359286.731438:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116096 00000100:00100000:0.0:1788359286.731450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116096 00000100:00100000:0.0:1788359286.731478:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420115968 00000100:00100000:0.0:1788359286.731482:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420115968 00000100:00100000:0.0:1788359286.731667:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:0.0:1788359286.731675:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420116096:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359286.731703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420116096:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359286.731709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:0.0:1788359286.731720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:0.0:1788359286.731725:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420115968:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359286.731744:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420115968:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 19us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359286.731750:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00080000:0.0:1788359286.731767:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359286.731770:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359286.731772:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788359286.731774:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788359286.731779:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359287.167422:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359287.484952:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359287.484978:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445345280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359287.485049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359287.485111:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345280 00000100:00100000:2.0:1788359287.485114:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445345152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359287.485120:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345280 00000100:00100000:2.0:1788359287.485145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359287.485164:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345152 00000100:00100000:0.0:1788359287.485167:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345152 00000100:00100000:2.0:1788359287.485181:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788359287.485521:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359287.485761:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345408:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359287.485796:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359287.485833:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788359287.485843:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788359287.485934:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345408 00000100:00100000:0.0:1788359287.485938:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345408 00000100:00080000:0.0:1788359287.485964:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359287.486031:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359287.486038:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445345152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359287.486071:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359287.486132:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445345152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359287.486139:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359287.486154:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788359287.486159:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359287.486172:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359287.486209:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359287.486215:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788359287.486251:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7530000 x1875230445345408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359287.486284:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359287.486532:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359287.486564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359287.486593:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345536 00000100:00100000:1.0:1788359287.486597:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345536 00000100:00100000:1.0:1788359287.486635:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788359287.486642:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445345536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359287.486653:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359287.486681:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445345536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359287.486688:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788359287.486706:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788359287.486723:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7525c00 x1875230445345536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359287.486737:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359287.487900:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445345664:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.487952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.487984:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445346176:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488023:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445346688:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488044:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488064:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788359287.488070:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445345792:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488122:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445346304:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488140:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488175:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345920:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488215:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445346432:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488233:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488251:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788359287.488256:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445346048:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488277:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488293:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445346560:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488312:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359287.488336:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345664 00000100:00100000:3.0:1788359287.488343:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345664 00000100:00100000:3.0:1788359287.488382:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788359287.488390:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445345664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488432:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445345664:12345-0@lo:400:kworker.0 Request processed in 43us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488440:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788359287.488446:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445345280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359287.488462:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359287.488468:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346176 00000100:00100000:3.0:1788359287.488471:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346176 00000100:00100000:2.0:1788359287.488507:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445345280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3306us (3446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488511:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345920 00000100:00100000:3.0:1788359287.488514:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345920 00000100:00100000:2.0:1788359287.488514:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788359287.488528:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788359287.488533:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445346176:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788359287.488549:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7530380 x1875230445345280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359287.488562:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445346176:12345-0@lo:400:kworker.0 Request processed in 29us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359287.488565:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445345280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359287.488568:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788359287.488578:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788359287.488578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c62e3800 x1875230445345152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359287.488583:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359287.488589:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445345152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359287.488619:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445345920:12345-0@lo:400:kworker.0 Request processed in 35us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359287.488624:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445345920:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488625:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788359287.488639:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346688 00000100:00100000:3.0:1788359287.488642:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346688 00000100:00100000:3.0:1788359287.488679:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445345792 00000100:00100000:3.0:1788359287.488682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445345792 00000100:00100000:3.0:1788359287.488692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346304 00000100:00100000:3.0:1788359287.488695:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346304 00000100:00100000:3.0:1788359287.488705:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346432 00000100:00100000:3.0:1788359287.488707:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346432 00000100:00100000:3.0:1788359287.488717:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346048 00000100:00100000:3.0:1788359287.488720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346048 00000100:00100000:3.0:1788359287.488728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346560 00000100:00100000:3.0:1788359287.488730:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346560 00000100:00100000:3.0:1788359287.488742:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359287.488748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488777:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445346688:12345-0@lo:400:kworker.0 Request processed in 30us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359287.488795:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788359287.488801:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445345792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788359287.488813:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359287.488817:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359287.488827:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445345792:12345-0@lo:400:kworker.0 Request processed in 27us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488832:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788359287.488842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359287.488847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445346304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488872:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445346304:12345-0@lo:400:kworker.0 Request processed in 25us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488884:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359287.488896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359287.488900:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445346432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488932:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445346432:12345-0@lo:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488937:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359287.488946:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788359287.488952:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445346048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.488976:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445346048:12345-0@lo:400:kworker.0 Request processed in 24us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.488982:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788359287.488991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788359287.488997:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445346560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445346560:12345-0@lo:400:kworker.0 Request processed in 23us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359287.489024:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788359287.489072:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445346048:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489081:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445346560:0@lo:400:kworker.0 00010000:00080000:3.0:1788359287.489102:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a11f80 x1875230445346432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359287.489110:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445346432:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489133:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445345792:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489142:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445346304:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445345664:0@lo:400:kworker.0 00000100:00100000:3.0:1788359287.489169:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445346176:0@lo:400:kworker.0 00010000:00080000:3.0:1788359287.489177:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a11880 x1875230445346688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359287.489185:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445346688:0@lo:400:kworker.0 00000001:02000400:1.0:1788359287.765336:0:10939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing yml_node 00010000:00010000:3.0:1788359288.191480:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359289.213048:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359290.045277:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445346816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359290.045360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359290.047166:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346816 00000100:00100000:3.0:1788359290.047181:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346816 00000100:00100000:3.0:1788359290.047260:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788359290.047270:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445346816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359290.047309:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359290.050373:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445346816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3094us (5002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359290.050387:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788359290.050483:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445346816:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359290.237229:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359290.557600:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445346944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359290.557700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359290.558082:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445346944 00000100:00100000:0.0:1788359290.558095:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445346944 00000100:00100000:0.0:1788359290.558170:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788359290.558197:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445346944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359290.558244:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359290.558693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445346944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 496us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359290.558703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788359290.558880:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445346944:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788359291.264593:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359291.837883:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359291.837929:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359291.837967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359291.837995:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116608 00000100:00100000:0.0:1788359291.838004:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116608 00000100:00100000:0.0:1788359291.838074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116736 00000100:00100000:0.0:1788359291.838078:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116736 00000100:00100000:0.0:1788359291.838108:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:0.0:1788359291.838118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420116608:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359291.838198:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420116608:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 81us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359291.838206:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:0.0:1788359291.838228:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 90 00000100:00100000:0.0:1788359291.838236:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420116736:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359291.838263:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420116736:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359291.838270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 90 00000100:00080000:0.0:1788359291.838288:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359291.838292:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359291.838449:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116480 00000100:00100000:2.0:1788359291.838454:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116480 00000100:00100000:2.0:1788359291.838524:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 278 00000100:00100000:2.0:1788359291.838533:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420116480:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359291.838569:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420116480:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 38us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359291.838576:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 278 00000001:02000400:0.0:1788359292.203145:0:11122:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.56.1 00010000:00010000:3.0:1788359292.293236:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359292.605372:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359292.605395:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445347200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359292.605521:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359292.605601:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347200 00000100:00100000:0.0:1788359292.605611:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347200 00000100:00100000:0.0:1788359292.605677:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788359292.605687:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445347200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359292.605718:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359292.605763:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445347200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359292.605770:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788359292.605793:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788359292.605824:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7530380 x1875230445347200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359292.605843:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445347200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359292.606605:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445347072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359292.606659:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359292.606700:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347072 00000100:00100000:2.0:1788359292.606704:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347072 00000100:00100000:2.0:1788359292.606746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788359292.606754:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445347072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359292.606769:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359292.606804:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445347072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359292.606811:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788359292.606826:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788359292.606851:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524380 x1875230445347072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359292.606866:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445347072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359292.606983:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359292.606993:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445347328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359292.607035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.607081:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347328 00000100:00100000:1.0:1788359292.607085:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347328 00000100:00100000:1.0:1788359292.607114:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788359292.607122:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445347328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359292.607140:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359292.607173:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445347328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.607180:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788359292.607204:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524e00 x1875230445347328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359292.607218:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445347328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359292.607882:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359292.607895:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445347456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359292.607933:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359292.607969:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347456 00000100:00100000:0.0:1788359292.607974:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347456 00000100:00100000:0.0:1788359292.608020:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788359292.608029:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445347456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359292.608053:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359292.608087:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445347456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359292.608094:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788359292.608124:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7242a00 x1875230445347456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359292.608157:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445347456:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788359292.609751:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359292.609768:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445347840:0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.609828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359292.609873:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445348352:0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.609900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359292.609924:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788359292.609930:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445347712:0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.609974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359292.609996:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445348224:0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.610035:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359292.610086:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348352 00000100:00100000:2.0:1788359292.610092:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348352 00000100:00100000:2.0:1788359292.610138:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347712 00000100:00100000:2.0:1788359292.610147:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347712 00000100:00100000:2.0:1788359292.610169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348224 00000100:00100000:2.0:1788359292.610172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348224 00000100:00100000:2.0:1788359292.610191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788359292.610199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445348352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.610251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445348352:12345-0@lo:400:kworker.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359292.610258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788359292.610273:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788359292.610280:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445347712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.610307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445347712:12345-0@lo:400:kworker.0 Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359292.610313:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788359292.610324:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359292.610331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445348224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.610357:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445348224:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359292.610362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788359292.610376:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359292.610379:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359292.610411:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445347712:0@lo:400:kworker.0 00000100:00100000:2.0:1788359292.610422:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445348224:0@lo:400:kworker.0 00010000:00080000:2.0:1788359292.610434:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c62e1180 x1875230445348352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359292.610445:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445348352:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610718:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445347968:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.610780:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445348480:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.610822:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788359292.610828:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445347584:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.610902:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c62e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445348096:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610924:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.610942:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445348608:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.610963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359292.610988:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347840 00000100:00100000:1.0:1788359292.610993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347840 00000100:00100000:1.0:1788359292.611033:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348096 00000100:00100000:1.0:1788359292.611048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348096 00000100:00100000:1.0:1788359292.611065:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788359292.611070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445347840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611111:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445347840:12345-0@lo:400:kworker.0 Request processed in 39us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.611117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788359292.611130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788359292.611136:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445348096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611166:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445348096:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.611171:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788359292.611186:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347968 00000100:00100000:1.0:1788359292.611189:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347968 00000100:00100000:1.0:1788359292.611205:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348480 00000100:00100000:1.0:1788359292.611208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348480 00000100:00100000:1.0:1788359292.611225:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348608 00000100:00100000:1.0:1788359292.611228:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348608 00000100:00100000:1.0:1788359292.611239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359292.611244:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445347968:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.611288:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359292.611298:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359292.611304:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445348480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611326:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445348480:12345-0@lo:400:kworker.0 Request processed in 22us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.611330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359292.611339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788359292.611344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445348608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611367:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445348608:12345-0@lo:400:kworker.0 Request processed in 22us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359292.611372:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788359292.611385:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359292.611388:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359292.611406:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445348096:0@lo:400:kworker.0 00010000:00080000:1.0:1788359292.611417:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6caca80 x1875230445348608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359292.611425:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445348608:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611433:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445347968:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611441:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445348480:0@lo:400:kworker.0 00000100:00100000:1.0:1788359292.611470:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445347840:0@lo:400:kworker.0 00000100:00100000:3.0:1788359292.611904:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445347584 00000100:00100000:3.0:1788359292.611911:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445347584 00000100:00100000:3.0:1788359292.611957:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788359292.611966:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359292.612013:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445347584:12345-0@lo:400:kworker.0 Request processed in 49us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359292.612027:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788359292.612073:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c62e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445347584:0@lo:400:kworker.0 00000001:00100000:3.0:1788359293.120251:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:3.0:1788359293.120261:0:9510:0:(genops.c:906:class_export_put()) final put ffffa0e9c745a000/10b7ecde-1562-4877-be1f-e5861af40d5e 00000001:00100000:1.0:1788359293.122330:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:1.0:1788359293.122358:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0e9c7413800/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:0.0:1788359293.125800:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c745a000/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-OST0001 00000020:00000080:0.0:1788359293.125856:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7413800/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-OST0000 00000020:00000080:0.0:1788359293.125886:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c745d000 for lustre-OST0001 00000020:00000080:0.0:1788359293.125892:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c7416000 for lustre-OST0000 00010000:00010000:0.0:1788359293.309098:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359294.332695:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359295.166682:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445348736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359295.166754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359295.166984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348736 00000100:00100000:1.0:1788359295.166993:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348736 00000100:00100000:1.0:1788359295.167075:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788359295.167085:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445348736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359295.167123:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359295.167171:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445348736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359295.167178:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788359295.167222:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445348736:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788359295.351849:0:11220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.56.1 00010000:00010000:3.0:1788359295.357854:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359295.678645:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445348864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359295.678717:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359295.678789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348864 00000100:00100000:3.0:1788359295.678797:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348864 00000100:00100000:3.0:1788359295.678837:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788359295.678846:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445348864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359295.678881:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359295.678934:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445348864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359295.678941:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788359295.679026:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445348864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359296.387762:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359296.956558:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359296.956603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359296.956608:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116864 00000100:00100000:3.0:1788359296.956619:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116864 00000100:00100000:3.0:1788359296.956742:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 280 00000100:00100000:3.0:1788359296.956753:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420116864:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359296.956802:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117120 00000100:00100000:2.0:1788359296.956809:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117120 00000100:00100000:3.0:1788359296.956827:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420116864:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359296.956837:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 280 00000100:00100000:2.0:1788359296.956858:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00080000:1.0:1788359296.956987:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359296.957043:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420117120:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359296.957093:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420117120:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 226us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359296.957100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:0.0:1788359296.958194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359296.958472:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420116992 00000100:00100000:2.0:1788359296.958480:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420116992 00000100:00100000:2.0:1788359296.958596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 98 00000100:00100000:2.0:1788359296.958607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420116992:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359296.958676:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420116992:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 72us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359296.958684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 98 00000100:00080000:1.0:1788359296.958767:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788359297.406352:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359297.724863:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445349120:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.724960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445349632:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725086:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445350144:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725106:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725132:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788359297.725138:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445348992:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725208:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445349504:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725254:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350016:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725305:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350528:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725353:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445349248:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725392:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445349760:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725432:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445350272:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725453:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725467:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359297.725471:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445349376:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725489:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445349888:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725530:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445350400:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725563:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.725600:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349120 00000100:00100000:2.0:1788359297.725609:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349120 00000100:00100000:2.0:1788359297.725654:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349632 00000100:00100000:2.0:1788359297.725659:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349632 00000100:00100000:3.0:1788359297.725662:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350016 00000100:00100000:3.0:1788359297.725670:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350016 00000100:00100000:2.0:1788359297.725687:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350144 00000100:00100000:2.0:1788359297.725690:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350144 00000100:00100000:3.0:1788359297.725701:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350528 00000100:00100000:3.0:1788359297.725706:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350528 00000100:00100000:2.0:1788359297.725715:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349760 00000100:00100000:2.0:1788359297.725723:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349760 00000100:00100000:3.0:1788359297.725734:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349888 00000100:00100000:3.0:1788359297.725738:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349888 00000100:00100000:2.0:1788359297.725741:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350272 00000100:00100000:2.0:1788359297.725745:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350272 00000100:00100000:2.0:1788359297.725761:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349376 00000100:00100000:2.0:1788359297.725763:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349376 00000100:00100000:3.0:1788359297.725783:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350400 00000100:00100000:3.0:1788359297.725788:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350400 00000100:00100000:2.0:1788359297.725789:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788359297.725801:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445349120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359297.725815:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359297.725827:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725858:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445349120:12345-0@lo:400:kworker.0 Request processed in 58us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.725865:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788359297.725878:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350016:12345-0@lo:400:kworker.0 Request processed in 53us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.725884:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788359297.725889:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359297.725893:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445349632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359297.725910:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359297.725920:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.725921:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445349632:12345-0@lo:400:kworker.0 Request processed in 31us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.725930:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359297.725940:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788359297.725946:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445350144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359297.725964:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350528:12345-0@lo:400:kworker.0 Request processed in 45us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359297.725971:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359297.725974:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445350144:12345-0@lo:400:kworker.0 Request processed in 28us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.725979:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788359297.726002:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359297.726007:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788359297.726013:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb00959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445349888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.726017:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445349760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359297.726063:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb00959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445349888:12345-0@lo:400:kworker.0 Request processed in 54us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359297.726070:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788359297.726226:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788359297.726233:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445350400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.726472:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445349760:12345-0@lo:400:kworker.0 Request processed in 458us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.726480:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359297.726516:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788359297.726525:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445350272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.726574:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445350272:12345-0@lo:400:kworker.0 Request processed in 52us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.726581:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788359297.726593:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359297.726599:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445349376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.726627:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445349376:12345-0@lo:400:kworker.0 Request processed in 27us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.726633:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359297.726660:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445348992 00000100:00100000:2.0:1788359297.726665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445348992 00000100:00100000:2.0:1788359297.726693:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788359297.726699:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445348992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.728535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445348992:12345-0@lo:400:kworker.0 Request processed in 1832us (3363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.728547:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788359297.728604:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349504 00000100:00100000:2.0:1788359297.728611:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349504 00000100:00100000:2.0:1788359297.728655:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445349248 00000100:00100000:2.0:1788359297.728658:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445349248 00000100:00100000:2.0:1788359297.728673:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788359297.728680:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445349504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729036:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445349504:12345-0@lo:400:kworker.0 Request processed in 354us (3798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.729043:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788359297.729057:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788359297.729064:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445349248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729112:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445349248:12345-0@lo:400:kworker.0 Request processed in 49us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.729118:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788359297.729163:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359297.729170:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359297.729173:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359297.729176:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359297.729198:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359297.729234:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.729280:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445348992:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729293:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445349504:0@lo:400:kworker.0 00010000:00080000:2.0:1788359297.729306:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad2300 x1875230445350016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.729316:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350016:0@lo:400:kworker.0 00010000:00080000:2.0:1788359297.729327:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad2a00 x1875230445350528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.729335:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350528:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729346:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445349120:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729358:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445349632:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729368:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445350144:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.729403:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445350784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359297.729427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.729472:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445349376:0@lo:400:kworker.0 00010000:00080000:2.0:1788359297.729486:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad1500 x1875230445349888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.729515:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445349888:0@lo:400:kworker.0 00000100:00100000:3.0:1788359297.731328:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445350400:12345-0@lo:400:kworker.0 Request processed in 5083us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359297.731359:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788359297.731482:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad1f80 x1875230445350400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.731648:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445350400:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.731667:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445349248:0@lo:400:kworker.0 00010000:00080000:2.0:1788359297.731680:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad1c00 x1875230445349760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.731689:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445349760:0@lo:400:kworker.0 00010000:00080000:2.0:1788359297.731701:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad1180 x1875230445350272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359297.737375:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445351040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359297.737459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.737545:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445350272:0@lo:400:kworker.0 00000100:00100000:2.0:1788359297.737598:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445350912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359297.737629:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359297.737668:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350656 00000100:00100000:2.0:1788359297.737676:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350656 00000100:00100000:2.0:1788359297.737787:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350784 00000100:00100000:2.0:1788359297.737792:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350784 00000100:00100000:2.0:1788359297.737805:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351040 00000100:00100000:2.0:1788359297.737808:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351040 00000100:00100000:2.0:1788359297.737818:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445350912 00000100:00100000:2.0:1788359297.737820:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445350912 00000100:00100000:2.0:1788359297.737852:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359297.737859:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359297.737895:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359297.738023:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445350656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (8787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359297.738030:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788359297.738038:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788359297.738044:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445350784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359297.738061:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00002000:00000024:1.0:1788359297.738066:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359297.738071:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445351040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359297.738083:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359297.738121:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445350784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (8691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.738130:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445351040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.738137:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788359297.738151:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788359297.738157:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445350912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359297.738166:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359297.738191:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788359297.738195:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445350912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359297.738203:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788359297.738236:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cadc00 x1875230445351040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788359297.738245:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b1180 x1875230445350912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359297.738258:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445351040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359297.738263:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445350912:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788359297.738288:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7530380 x1875230445350784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359297.738300:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445350784:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788359297.738614:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b2300 x1875230445350656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359297.738780:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445350656:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788359298.020289:0:11317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.56.1 00010000:00010000:3.0:1788359298.428697:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359299.452706:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788359299.736945:0:11365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 10:28:17 EDT 2026 00000100:00100000:2.0:1788359300.289312:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359300.289572:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445351168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359300.289665:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359300.289827:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351168 00000100:00100000:1.0:1788359300.289838:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351168 00000100:00100000:1.0:1788359300.289910:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788359300.289922:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445351168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359300.289977:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359300.290044:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445351168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359300.290063:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788359300.290319:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445351168:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788359300.477686:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359300.797900:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445351296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359300.798012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359300.798109:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351296 00000100:00100000:2.0:1788359300.798119:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351296 00000100:00100000:2.0:1788359300.798176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788359300.798187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445351296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788359300.798244:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788359300.798302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445351296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359300.798309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788359300.802012:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445351296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359301.520294:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359302.079168:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359302.079224:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359302.079275:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359302.080131:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117504 00000100:00100000:2.0:1788359302.080148:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117504 00000100:00100000:2.0:1788359302.080240:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117376 00000100:00100000:2.0:1788359302.080245:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117376 00000100:00080000:0.0:1788359302.080269:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359302.080276:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359302.080282:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:2.0:1788359302.080297:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420117504:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359302.080424:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420117504:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 131us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.080434:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:2.0:1788359302.080457:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00100000:2.0:1788359302.080480:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420117376:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359302.080537:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420117376:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 58us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.080544:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00100000:1.0:1788359302.080857:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117248 00000100:00100000:1.0:1788359302.080864:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117248 00000100:00100000:1.0:1788359302.080913:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 282 00000100:00100000:1.0:1788359302.080922:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2405:x1875230420117248:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359302.080980:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2405:x1875230420117248:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 59us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359302.080986:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 282 00010000:00010000:1.0:1788359302.524680:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359302.845015:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445351424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359302.845110:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.845217:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445351552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359302.845247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.845309:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351424 00000100:00100000:2.0:1788359302.845319:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351424 00000100:00100000:2.0:1788359302.845393:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351552 00000100:00100000:2.0:1788359302.845397:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351552 00000100:00100000:2.0:1788359302.845417:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788359302.845429:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445351424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359302.845471:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359302.845549:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445351424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.845557:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788359302.845589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788359302.845597:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445351552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359302.845615:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788359302.845621:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cadc00 x1875230445351424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.845640:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445351552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359302.845643:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445351424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359302.845647:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788359302.845668:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359302.845673:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788359302.845715:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693ed80 x1875230445351552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.845729:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445351552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359302.845742:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359302.845748:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445351680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359302.845772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359302.845819:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351680 00000100:00100000:3.0:1788359302.845824:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351680 00000100:00100000:3.0:1788359302.845853:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788359302.845858:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445351680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359302.845869:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359302.845901:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445351680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359302.845908:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788359302.845909:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.845976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846015:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445352320:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846063:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445352832:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846111:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359302.846116:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445351936:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359302.846145:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351808 00000100:00100000:3.0:1788359302.846149:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351808 00000100:00100000:2.0:1788359302.846155:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445352448:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846192:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445352960:0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846204:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788359302.846211:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445351808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846216:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846242:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352320 00000100:00100000:3.0:1788359302.846246:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445351808:12345-0@lo:400:kworker.0 Request processed in 36us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846246:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352320 00000100:00100000:3.0:1788359302.846252:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788359302.846272:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788359302.846279:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445352320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846288:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445351808:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445352320:12345-0@lo:400:kworker.0 Request processed in 56us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788359302.846373:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352832 00000100:00100000:2.0:1788359302.846377:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352832 00000100:00100000:2.0:1788359302.846405:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445351936 00000100:00100000:2.0:1788359302.846408:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445351936 00000100:00100000:2.0:1788359302.846425:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352448 00000100:00100000:2.0:1788359302.846427:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352448 00000100:00100000:2.0:1788359302.846440:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788359302.846447:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445352832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445352832:12345-0@lo:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788359302.846521:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788359302.846528:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445351936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846557:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445351936:12345-0@lo:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846563:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788359302.846575:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788359302.846581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445352448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846601:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445351936:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445352448:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788359302.846622:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445352448:0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846631:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445352320:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846639:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352960 00000100:00100000:2.0:1788359302.846642:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352960 00010000:00080000:3.0:1788359302.846643:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693ca80 x1875230445352832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359302.846654:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445352832:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846669:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359302.846675:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445352960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846728:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445352960:12345-0@lo:400:kworker.0 Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.846735:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788359302.846770:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359302.846774:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359302.846777:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359302.846779:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788359302.846788:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb006b2300 x1875230445352960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.846789:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445352064:0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846798:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb006b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445352960:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846816:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359302.846834:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352064 00000100:00100000:2.0:1788359302.846834:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445352576:0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.846838:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352064 00000100:00100000:2.0:1788359302.846855:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359302.846863:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788359302.846868:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445352064:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788359302.846875:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a10000 x1875230445351680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.846890:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445351680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359302.846898:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445352064:12345-0@lo:400:kworker.0 Request processed in 30us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359302.846904:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359302.846906:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445352064:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846912:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788359302.846919:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445352192:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.846953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359302.846978:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445352704:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.847000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359302.847016:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352576 00000100:00100000:3.0:1788359302.847020:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352576 00000100:00100000:2.0:1788359302.847024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352192 00000100:00100000:2.0:1788359302.847026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352192 00000100:00100000:2.0:1788359302.847046:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445352704 00000100:00100000:2.0:1788359302.847049:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445352704 00000100:00100000:3.0:1788359302.847058:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788359302.847063:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445352192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.847064:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788359302.847069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445352576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359302.847098:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445352192:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.847100:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445352576:12345-0@lo:400:kworker.0 Request processed in 31us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359302.847105:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788359302.847632:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359302.847649:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445353088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359302.847692:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359302.847765:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353088 00000100:00100000:0.0:1788359302.847772:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353088 00000100:00100000:1.0:1788359302.847904:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359302.847917:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445353088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359302.847936:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359302.847994:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445353088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.847995:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788359302.848009:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788359302.848015:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788359302.848023:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445352704:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788359302.848057:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bce00 x1875230445353088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.848067:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445352704:12345-0@lo:400:kworker.0 Request processed in 47us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359302.848073:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788359302.848074:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445353088:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788359302.848099:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359302.848103:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359302.848134:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445352192:0@lo:400:kworker.0 00000100:00100000:2.0:1788359302.848453:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445352704:0@lo:400:kworker.0 00010000:00080000:2.0:1788359302.848473:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693d880 x1875230445352576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359302.848484:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445352576:0@lo:400:kworker.0 00010000:00010000:3.0:1788359303.548749:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359304.573559:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359305.405075:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359305.405108:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445353216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359305.405215:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359305.405299:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353216 00000100:00100000:2.0:1788359305.405308:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353216 00000100:00100000:2.0:1788359305.405357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788359305.405366:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445353216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359305.405409:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359305.405554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445353216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 188us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359305.405568:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788359305.405624:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445353216:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359305.603382:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359305.916697:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359305.916728:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445353344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359305.916817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359305.916944:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353344 00000100:00100000:0.0:1788359305.916955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353344 00000100:00100000:0.0:1788359305.917024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788359305.917035:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445353344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359305.917079:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359305.917146:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445353344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359305.917153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788359305.917734:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445353344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359306.624466:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359307.203684:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359307.203778:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359307.203826:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359307.203869:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117888 00000100:00100000:0.0:1788359307.203881:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117888 00000100:00100000:0.0:1788359307.203966:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117760 00000100:00100000:0.0:1788359307.203969:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117760 00000100:00100000:0.0:1788359307.203994:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:0.0:1788359307.204007:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420117888:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359307.204103:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420117888:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 100us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.204110:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:0.0:1788359307.204140:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00100000:0.0:1788359307.204147:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420117760:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359307.204173:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420117760:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.204179:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00080000:0.0:1788359307.204197:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359307.204202:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359307.210056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420117632 00000100:00100000:2.0:1788359307.210082:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420117632 00000100:00100000:2.0:1788359307.210187:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 284 00000100:00100000:2.0:1788359307.210200:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420117632:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359307.210328:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2404:x1875230420117632:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 131us (6660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359307.210336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 284 00010000:00010000:0.0:1788359307.645890:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359307.964866:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359307.964929:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445353472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359307.965027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359307.965232:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353472 00000100:00100000:1.0:1788359307.965243:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353472 00000100:00100000:1.0:1788359307.965333:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788359307.965348:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445353472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359307.965390:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359307.965463:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445353472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359307.965471:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788359307.965570:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6caca80 x1875230445353472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359307.965593:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445353472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788359307.965679:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359307.966166:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445353600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359307.966214:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.966453:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353600 00000100:00100000:0.0:1788359307.966462:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353600 00000100:00100000:0.0:1788359307.966557:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788359307.966568:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445353600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359307.966619:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359307.966668:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445353600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.966675:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788359307.966787:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788359307.966817:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bca80 x1875230445353600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359307.966836:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445353600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359307.968839:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359307.968881:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445353728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359307.968985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359307.969058:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353728 00000100:00100000:1.0:1788359307.969069:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353728 00000100:00100000:1.0:1788359307.969145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788359307.969156:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445353728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359307.969185:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359307.969236:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445353728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359307.969263:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788359307.969288:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788359307.969327:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6caca80 x1875230445353728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359307.969365:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445353728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359307.971281:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445353984:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971421:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445354496:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971459:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971517:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445355008:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971571:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788359307.971576:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445353856:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971631:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445354368:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971680:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445354880:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.971740:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353984 00000100:00100000:0.0:1788359307.971749:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353984 00000100:00100000:0.0:1788359307.971803:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354496 00000100:00100000:0.0:1788359307.971807:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354496 00000100:00100000:0.0:1788359307.971829:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355008 00000100:00100000:0.0:1788359307.971831:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355008 00000100:00100000:0.0:1788359307.971847:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354880 00000100:00100000:0.0:1788359307.971849:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354880 00000100:00100000:0.0:1788359307.971868:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788359307.971877:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445353984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.971967:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445353984:12345-0@lo:400:kworker.0 Request processed in 90us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.971975:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788359307.971994:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788359307.972001:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445354496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972030:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445354496:12345-0@lo:400:kworker.0 Request processed in 30us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972036:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788359307.972048:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788359307.972054:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445355008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972094:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445355008:12345-0@lo:400:kworker.0 Request processed in 40us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972100:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788359307.972111:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788359307.972117:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445354880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972144:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445354880:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972149:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788359307.972173:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354368 00000100:00100000:0.0:1788359307.972176:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354368 00000100:00100000:0.0:1788359307.972204:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359307.972210:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972245:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445354368:12345-0@lo:400:kworker.0 Request processed in 35us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972252:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359307.972291:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445354240:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972321:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.972340:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445354752:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972365:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.972389:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788359307.972396:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445354112:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.972439:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445354624:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359307.972488:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354752 00000100:00100000:0.0:1788359307.972492:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354752 00000100:00100000:0.0:1788359307.972562:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359307.972569:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445354752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972606:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445354752:12345-0@lo:400:kworker.0 Request processed in 37us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972613:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359307.972634:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354112 00000100:00100000:0.0:1788359307.972638:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354112 00000100:00100000:0.0:1788359307.972664:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359307.972670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445354112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972701:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445354112:12345-0@lo:400:kworker.0 Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972707:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359307.972722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354240 00000100:00100000:0.0:1788359307.972725:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354240 00000100:00100000:0.0:1788359307.972745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445354624 00000100:00100000:0.0:1788359307.972748:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445354624 00000100:00100000:0.0:1788359307.972780:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788359307.972785:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445354240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972819:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445354240:12345-0@lo:400:kworker.0 Request processed in 34us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972826:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788359307.972837:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788359307.972844:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445354624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972871:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445354624:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359307.972877:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788359307.972941:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445354112:0@lo:400:kworker.0 00010000:00080000:0.0:1788359307.972956:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bc700 x1875230445354624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359307.972966:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445354624:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.972977:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445354240:0@lo:400:kworker.0 00010000:00080000:0.0:1788359307.972986:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bca80 x1875230445354752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359307.972994:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445354752:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.973035:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445354368:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.973048:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445354880:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.973059:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445353984:0@lo:400:kworker.0 00000100:00100000:0.0:1788359307.973070:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445354496:0@lo:400:kworker.0 00010000:00080000:0.0:1788359307.973092:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eac12af480 x1875230445355008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359307.973102:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445355008:0@lo:400:kworker.0 00000100:00080000:1.0:1788359307.973806:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359307.973816:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359307.973818:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359307.974078:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445353856 00000100:00100000:3.0:1788359307.974088:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445353856 00000100:00100000:3.0:1788359307.974240:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788359307.974252:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445353856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359307.974340:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445353856:12345-0@lo:400:kworker.0 Request processed in 91us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359307.974348:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788359307.974452:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359307.974465:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445355136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359307.974524:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359307.974875:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355136 00000100:00100000:1.0:1788359307.974881:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355136 00000100:00100000:1.0:1788359307.974939:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788359307.974949:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445355136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359307.974970:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359307.975026:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445355136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359307.975033:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788359307.975221:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a11f80 x1875230445355136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359307.975242:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445355136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359307.975353:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445353856:0@lo:400:kworker.0 00010000:00010000:2.0:1788359308.669001:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359309.692713:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359310.524937:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445355264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359310.525071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359310.525183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355264 00000100:00100000:1.0:1788359310.525191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355264 00000100:00100000:1.0:1788359310.525245:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788359310.525255:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445355264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359310.525291:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359310.530804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445355264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5539us (5723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359310.531072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788359310.532186:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445355264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359310.718706:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359311.042985:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445355392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359311.043063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359311.043142:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355392 00000100:00100000:0.0:1788359311.043150:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355392 00000100:00100000:0.0:1788359311.043194:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359311.043203:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445355392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359311.043237:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359311.043327:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445355392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359311.043334:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359311.043377:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445355392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359311.743280:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359312.317240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359312.317303:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359312.317341:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359312.317441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118144 00000100:00100000:3.0:1788359312.317454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118144 00000100:00100000:2.0:1788359312.317487:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118272 00000100:00100000:1.0:1788359312.317564:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118016 00000100:00100000:1.0:1788359312.317583:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118016 00000100:00100000:1.0:1788359312.317640:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 286 00000100:00100000:1.0:1788359312.317651:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420118016:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359312.317728:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2403:x1875230420118016:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 79us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359312.317819:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118272 00000100:00100000:1.0:1788359312.317855:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 286 00000100:00100000:3.0:1788359312.318695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00100000:3.0:1788359312.318706:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420118144:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359312.318765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420118144:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 62us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359312.318772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00080000:0.0:1788359312.321802:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359312.322070:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00100000:2.0:1788359312.322085:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420118272:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359312.322179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420118272:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 99us (4837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359312.322188:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00080000:1.0:1788359312.322261:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788359312.764911:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359313.085202:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359313.085224:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445355520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359313.085302:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359313.085419:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445355648:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359313.085463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359313.085698:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355520 00000100:00100000:0.0:1788359313.085705:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355520 00000100:00100000:0.0:1788359313.085776:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355648 00000100:00100000:0.0:1788359313.085780:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355648 00000100:00100000:0.0:1788359313.085800:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788359313.085809:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445355520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359313.085839:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359313.085910:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445355520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359313.085917:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788359313.085933:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788359313.085939:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445355648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359313.085952:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359313.085981:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445355648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359313.085987:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788359313.086019:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eac12ae300 x1875230445355648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359313.086037:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445355648:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788359313.086064:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad0700 x1875230445355520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359313.086076:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445355520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788359313.086142:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359313.086146:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359313.086374:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445355776:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.086411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359313.086437:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445356288:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.086461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359313.086479:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445356800:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.086533:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359313.086553:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788359313.086558:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445356160:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.086578:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359313.086591:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445356672:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.086767:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356800 00000100:00100000:3.0:1788359313.086771:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356800 00000100:00100000:3.0:1788359313.086808:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356160 00000100:00100000:3.0:1788359313.086811:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356160 00000100:00100000:3.0:1788359313.086830:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359313.086837:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445356800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.086890:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445356800:12345-0@lo:400:kworker.0 Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.086896:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359313.086910:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788359313.086916:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445356160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.086943:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445356160:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.086948:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788359313.086966:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445356032:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.086991:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087011:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445356544:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087030:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087058:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445357056:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087081:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087099:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788359313.087105:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087140:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445356416:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087169:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445356928:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359313.087209:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356288 00000100:00100000:3.0:1788359313.087212:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356288 00000100:00100000:3.0:1788359313.087236:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356032 00000100:00100000:3.0:1788359313.087239:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356032 00000100:00100000:3.0:1788359313.087251:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788359313.087257:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445356288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087291:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445356288:12345-0@lo:400:kworker.0 Request processed in 34us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087297:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788359313.087308:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788359313.087313:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445356032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087343:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445356032:12345-0@lo:400:kworker.0 Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087349:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788359313.087365:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356544 00000100:00100000:3.0:1788359313.087368:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356544 00000100:00100000:3.0:1788359313.087385:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355904 00000100:00100000:3.0:1788359313.087388:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355904 00000100:00100000:3.0:1788359313.087410:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356416 00000100:00100000:3.0:1788359313.087412:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356416 00000100:00100000:3.0:1788359313.087425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356928 00000100:00100000:3.0:1788359313.087428:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356928 00000100:00100000:3.0:1788359313.087442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788359313.087447:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445356544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087478:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445356544:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087484:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788359313.087516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788359313.087594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445355904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087685:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445355904:12345-0@lo:400:kworker.0 Request processed in 93us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788359313.087703:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788359313.087709:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445356416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087733:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445356416:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788359313.087749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788359313.087754:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445356928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087777:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445356928:12345-0@lo:400:kworker.0 Request processed in 23us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.087782:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788359313.087824:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.087834:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445356416:0@lo:400:kworker.0 00010000:00080000:3.0:1788359313.088167:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff7100 x1875230445356928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359313.088178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445356928:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.088189:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445356032:0@lo:400:kworker.0 00010000:00080000:3.0:1788359313.088198:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6374700 x1875230445356544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359313.088206:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445356544:0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.088304:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445355776 00000100:00100000:3.0:1788359313.088308:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445355776 00000100:00100000:3.0:1788359313.088354:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788359313.088360:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445355776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359313.088392:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445355776:12345-0@lo:400:kworker.0 Request processed in 33us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359313.088397:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788359313.088422:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445357184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359313.088462:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359313.088695:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357056 00000100:00100000:2.0:1788359313.088699:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357056 00000100:00100000:2.0:1788359313.088742:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788359313.088749:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445357056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359313.088803:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445357056:12345-0@lo:400:kworker.0 Request processed in 54us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359313.088809:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788359313.088830:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359313.088838:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445357312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359313.088875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359313.088900:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357184 00000100:00100000:2.0:1788359313.088903:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357184 00000100:00100000:2.0:1788359313.088928:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357312 00000100:00100000:2.0:1788359313.088931:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357312 00000100:00100000:2.0:1788359313.088943:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359313.088949:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445357184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359313.088962:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359313.088995:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445357184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359313.089001:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359313.089011:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359313.089016:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445357312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359313.089025:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359313.089047:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445357312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359313.089062:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788359313.089088:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad0700 x1875230445357312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359313.089101:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445357312:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788359313.089110:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a13800 x1875230445357184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359313.089120:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445357184:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788359313.089149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff6300 x1875230445357056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359313.089156:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445357056:0@lo:400:kworker.0 00000100:00080000:2.0:1788359313.089184:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359313.089188:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359313.089190:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359313.089193:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359313.092130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359313.092192:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445355776:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.092258:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445356288:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.092275:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445356800:0@lo:400:kworker.0 00000100:00100000:1.0:1788359313.092305:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445356160:0@lo:400:kworker.0 00000100:00100000:2.0:1788359313.092481:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445356672 00000100:00100000:2.0:1788359313.092488:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445356672 00000100:00100000:2.0:1788359313.092572:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359313.092582:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445356672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359313.092662:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445356672:12345-0@lo:400:kworker.0 Request processed in 81us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359313.092669:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788359313.095980:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6377100 x1875230445356672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359313.096019:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445356672:0@lo:400:kworker.0 00010000:00010000:0.0:1788359313.788689:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788359314.367387:0:11996:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:28:32 (1788359312) === 00000100:00100000:1.0:1788359314.734646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.734747:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118400 00000100:00100000:3.0:1788359314.734761:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118400 00000100:00100000:1.0:1788359314.734871:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 288 00000100:00100000:1.0:1788359314.734888:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:8748:x1875230420118400:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788359314.737417:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359314.737454:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6d88 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359314.737574:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d88 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359314.737589:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d88 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359314.737602:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057800, rc 0) 00000100:00100000:1.0:1788359314.737709:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420118400:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 2826us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359314.737719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 288 00000100:00100000:0.0:1788359314.743743:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.744082:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118528 00000100:00100000:3.0:1788359314.744097:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118528 00000100:00100000:3.0:1788359314.744167:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 289 00000100:00100000:3.0:1788359314.744178:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420118528:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788359314.744369:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420118528:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 185us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.744394:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 289 00000100:00100000:3.0:1788359314.746591:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.746840:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118656 00000100:00100000:1.0:1788359314.746853:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118656 00000100:00100000:1.0:1788359314.746980:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 290 00000100:00100000:1.0:1788359314.746993:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420118656:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788359314.747180:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420118656:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 189us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359314.747188:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 290 00000100:00100000:3.0:1788359314.749912:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359314.750354:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118784 00000100:00100000:0.0:1788359314.750367:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118784 00000100:00100000:0.0:1788359314.750426:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 291 00000100:00100000:0.0:1788359314.750436:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420118784:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359314.750644:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420118784:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 208us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.750652:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 291 00000100:00100000:2.0:1788359314.776632:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359314.777120:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420118912 00000100:00100000:0.0:1788359314.777141:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420118912 00000100:00100000:0.0:1788359314.777203:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 292 00000100:00100000:0.0:1788359314.777213:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420118912:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359314.777384:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420118912:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 171us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.777392:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 292 00000100:00100000:3.0:1788359314.786086:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.786238:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119040 00000100:00100000:1.0:1788359314.786253:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119040 00000100:00100000:1.0:1788359314.786331:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 293 00000100:00100000:1.0:1788359314.786342:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420119040:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788359314.786839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8752:x1875230420119040:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 485us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359314.786851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 293 00000100:00100000:1.0:1788359314.789242:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.789652:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119168 00000100:00100000:3.0:1788359314.789668:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119168 00000100:00100000:3.0:1788359314.789789:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 294 00000100:00100000:3.0:1788359314.789801:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:8748:x1875230420119168:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788359314.789841:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359314.789870:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feae579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6db9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359314.789911:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feae579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6db9 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359314.789923:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feae579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6db9 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359314.789935:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031a00, rc 0) 00000100:00100000:3.0:1788359314.790023:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:8748:x1875230420119168:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 224us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.790031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 294 00000100:00100000:2.0:1788359314.792272:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.792727:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119296 00000100:00100000:1.0:1788359314.792742:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119296 00000100:00100000:1.0:1788359314.792813:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 295 00000100:00100000:1.0:1788359314.792964:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:8748:x1875230420119296:12345-192.168.202.52@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788359314.793001:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788359314.793038:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788359314.793043:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788359314.793046:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788359314.793049:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788359314.793052:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788359314.801225:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:8748:x1875230420119296:12345-192.168.202.52@tcp:256:mount.lustre.0 Request processed in 8386us (8948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.801244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 295 00000100:00100000:3.0:1788359314.808602:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359314.808795:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119424 00000100:00100000:0.0:1788359314.808810:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119424 00000100:00100000:0.0:1788359314.808902:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 296 00000100:00100000:0.0:1788359314.808913:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:8748:x1875230420119424:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788359314.808937:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359314.808961:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6dc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359314.809000:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359314.809014:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359314.809025:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a000, rc 0) 00000100:00100000:0.0:1788359314.809112:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8748:x1875230420119424:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 201us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.809139:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 296 00000100:00100000:2.0:1788359314.812472:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.812766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119552 00000100:00100000:3.0:1788359314.812800:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119552 00010000:00010000:2.0:1788359314.813140:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359314.813257:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 297 00000100:00100000:3.0:1788359314.813268:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8748:x1875230420119552:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788359314.813518:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8748:x1875230420119552:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 231us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.813527:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 297 00000100:00100000:1.0:1788359314.816873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.817033:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119680 00000100:00100000:3.0:1788359314.817047:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119680 00000100:00100000:3.0:1788359314.817167:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 298 00000100:00100000:3.0:1788359314.817179:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8748:x1875230420119680:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788359314.817583:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8748:x1875230420119680:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 404us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.817593:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 298 00000100:00100000:1.0:1788359314.820677:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.821142:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119808 00000100:00100000:3.0:1788359314.821154:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119808 00000100:00100000:3.0:1788359314.821258:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 299 00000100:00100000:3.0:1788359314.821270:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8755:x1875230420119808:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788359314.821602:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8755:x1875230420119808:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 333us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.821610:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 299 00000100:00100000:2.0:1788359314.827008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.827235:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420119936 00000100:00100000:3.0:1788359314.827250:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420119936 00000100:00100000:3.0:1788359314.827318:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 300 00000100:00100000:3.0:1788359314.827335:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8755:x1875230420119936:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788359314.827555:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:8755:x1875230420119936:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 228us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.827572:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 300 00000100:00100000:1.0:1788359314.831199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.834761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.837267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.838924:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120064 00000100:00100000:3.0:1788359314.838954:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120064 00000100:00100000:0.0:1788359314.839134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120320 00000100:00100000:0.0:1788359314.839139:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120320 00000100:00100000:0.0:1788359314.839176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:0.0:1788359314.839186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875230420120064:12345-192.168.202.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788359314.839232:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from eacee332-d1ce-4046-a685-c3d51a3ce37d@192.168.202.52@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1788359314.839305:0:6516:0:(genops.c:1406:class_connect()) connect: client eacee332-d1ce-4046-a685-c3d51a3ce37d, cookie 0x49dd053b5feae587 00000004:00100000:0.0:1788359314.839353:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788359314.839568:0:6516:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6355000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359314.840040:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2401:x1875230420120064:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 851us (8853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.840051:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:0.0:1788359314.840082:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:0.0:1788359314.840089:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875230420120320:12345-192.168.202.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788359314.840109:0:6516:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from eacee332-d1ce-4046-a685-c3d51a3ce37d@192.168.202.52@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1788359314.840141:0:6516:0:(genops.c:1406:class_connect()) connect: client eacee332-d1ce-4046-a685-c3d51a3ce37d, cookie 0x49dd053b5feae58e 00000004:00100000:0.0:1788359314.840164:0:6516:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788359314.840243:0:6516:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6352800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359314.840273:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2401:x1875230420120320:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 184us (5529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.840280:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:1.0:1788359314.841258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.841515:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120704 00000100:00100000:3.0:1788359314.841527:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120704 00000100:00100000:3.0:1788359314.841597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120832 00000100:00100000:3.0:1788359314.841600:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120832 00000100:00100000:3.0:1788359314.841624:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:3.0:1788359314.841633:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420120704:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359314.841703:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420120704:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 71us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.841709:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:3.0:1788359314.841726:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00100000:3.0:1788359314.841733:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420120832:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359314.841759:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420120832:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.841765:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00080000:2.0:1788359314.844608:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359314.844624:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359314.849341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.849447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359314.852296:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120448 00000100:00100000:3.0:1788359314.852297:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120192 00000100:00100000:3.0:1788359314.852323:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120192 00000100:00100000:2.0:1788359314.852323:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120448 00000100:00080000:0.0:1788359314.852450:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359314.852457:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359314.852474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:3.0:1788359314.852491:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:0:x1875230420120192:12345-192.168.202.52@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788359314.852547:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:2.0:1788359314.852561:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:0:x1875230420120448:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788359314.852572:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:2.0:1788359314.852616:0:7748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359314.852727:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:0:x1875230420120448:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 169us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.852777:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:0:x1875230420120192:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 290us (3326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.854716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359314.855690:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120576 00000100:00100000:0.0:1788359314.855720:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120576 00000100:00100000:2.0:1788359314.857758:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:3.0:1788359314.858523:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:2.0:1788359314.858717:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:2.0:1788359314.858739:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420120576:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788359314.858779:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788359314.858888:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420120576:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 159us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359314.858900:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359314.861747:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359314.861864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420120960 00000100:00100000:1.0:1788359314.861897:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420120960 00000100:00100000:1.0:1788359314.861976:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:1.0:1788359314.861987:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420120960:12345-192.168.202.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788359314.862084:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420120960:12345-192.168.202.52@tcp:40:mount.lustre.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359314.862093:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:3.0:1788359314.865201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359314.865323:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121344 00000100:00100000:2.0:1788359314.865341:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121344 00000100:00100000:2.0:1788359314.865487:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:2.0:1788359314.865558:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420121344:12345-192.168.202.52@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788359314.865664:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420121344:12345-192.168.202.52@tcp:900:mount.lustre.0 Request processed in 168us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359314.865672:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:2.0:1788359314.867110:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359314.867209:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359314.867324:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121088 00000100:00100000:0.0:1788359314.867335:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121088 00000100:00100000:3.0:1788359314.867349:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121216 00000100:00100000:3.0:1788359314.867370:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121216 00000100:00100000:0.0:1788359314.867430:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359314.867440:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1875230420121088:12345-192.168.202.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788359314.867478:0:8882:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from eacee332-d1ce-4046-a685-c3d51a3ce37d@192.168.202.52@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1788359314.867614:0:8882:0:(genops.c:1406:class_connect()) connect: client eacee332-d1ce-4046-a685-c3d51a3ce37d, cookie 0x49dd053b5feae595 00002000:00100000:0.0:1788359314.867629:0:8882:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eacee332-d1ce-4046-a685-c3d51a3ce37d/ffffa0e9c6356000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788359314.867644:0:8882:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788359314.867730:0:8882:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788359314.867762:0:8882:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6353800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359314.867891:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2401:x1875230420121088:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 451us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.867899:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359314.867925:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:0.0:1788359314.867929:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1875230420121216:12345-192.168.202.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788359314.867948:0:8882:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from eacee332-d1ce-4046-a685-c3d51a3ce37d@192.168.202.52@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:0.0:1788359314.867965:0:8882:0:(genops.c:1406:class_connect()) connect: client eacee332-d1ce-4046-a685-c3d51a3ce37d, cookie 0x49dd053b5feae59c 00002000:00100000:0.0:1788359314.867971:0:8882:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eacee332-d1ce-4046-a685-c3d51a3ce37d/ffffa0e9c6354800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788359314.867977:0:8882:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788359314.868019:0:8882:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788359314.868035:0:8882:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6355800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359314.868061:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2401:x1875230420121216:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 129us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359314.868095:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:0.0:1788359314.873290:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359314.873441:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121472 00000100:00100000:3.0:1788359314.873452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121472 00000100:00100000:3.0:1788359314.873596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:3.0:1788359314.873606:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420121472:12345-192.168.202.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788359314.873701:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788359314.873794:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:8748:x1875230420121472:12345-192.168.202.52@tcp:33:mount.lustre.0 Request processed in 189us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359314.873811:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:2.0:1788359315.644720:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359315.644754:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445357440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359315.645018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359315.645166:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357440 00000100:00100000:2.0:1788359315.645181:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357440 00000100:00100000:2.0:1788359315.645324:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359315.645335:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445357440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359315.645386:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359315.645461:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445357440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359315.645468:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788359315.645701:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445357440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359315.836968:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359316.158404:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359316.158443:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445357568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359316.158576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359316.159641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357568 00000100:00100000:3.0:1788359316.159657:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357568 00000100:00100000:3.0:1788359316.159721:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788359316.160003:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445357568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359316.160076:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359316.160195:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445357568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 460us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359316.160204:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788359316.160299:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445357568:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359316.860972:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359317.884829:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359318.204706:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359318.204741:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359318.204855:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359318.204939:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357696 00000100:00100000:2.0:1788359318.204949:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357696 00000100:00100000:2.0:1788359318.205036:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788359318.205059:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445357696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359318.205107:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359318.205163:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445357696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359318.205171:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788359318.205210:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788359318.205252:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7597b80 x1875230445357696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359318.205275:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445357696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359318.205947:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445357824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359318.205990:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.206109:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357824 00000100:00100000:3.0:1788359318.206116:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357824 00000100:00100000:3.0:1788359318.206165:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788359318.206177:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445357824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788359318.206205:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359318.206247:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445357824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.206268:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788359318.206287:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788359318.206537:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693df80 x1875230445357824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359318.206557:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445357824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359318.207467:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445358080:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.207559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.207593:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445358592:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.207721:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445358336:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.207773:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359318.207811:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445358848:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.207825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359318.207857:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359318.207903:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445357952:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.207913:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788359318.207916:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445359104:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.207924:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445358208:0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.207950:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.208002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359318.208005:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445358464:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.208012:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359318.208059:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.208064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359318.208091:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445358976:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.208093:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358080 00000100:00100000:3.0:1788359318.208105:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358080 00000100:00100000:1.0:1788359318.208136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358208 00000100:00100000:1.0:1788359318.208145:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358208 00000100:00100000:3.0:1788359318.208170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358336 00000100:00100000:3.0:1788359318.208178:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358336 00000100:00100000:1.0:1788359318.208199:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358464 00000100:00100000:1.0:1788359318.208205:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358464 00000100:00100000:3.0:1788359318.208210:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358592 00000100:00100000:3.0:1788359318.208217:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358592 00000100:00100000:1.0:1788359318.208237:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359318.208248:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0df3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445358208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.208305:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0df3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445358208:12345-0@lo:400:kworker.0 Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359318.208313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359318.208655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788359318.208663:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445358464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.208718:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445358464:12345-0@lo:400:kworker.0 Request processed in 56us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359318.208724:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788359318.208915:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.208930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359104 00000100:00100000:3.0:1788359318.208937:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359104 00000100:00100000:2.0:1788359318.208950:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445359232:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.208959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358720 00000100:00100000:3.0:1788359318.208967:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358720 00000100:00100000:3.0:1788359318.208998:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788359318.209005:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.209014:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445358080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209113:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445358080:12345-0@lo:400:kworker.0 Request processed in 105us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209123:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788359318.209146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788359318.209153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445358336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209192:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445358336:12345-0@lo:400:kworker.0 Request processed in 40us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209220:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788359318.209306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788359318.209316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445358592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445358592:12345-0@lo:400:kworker.0 Request processed in 43us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209362:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788359318.209373:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788359318.209379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445359104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209407:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445359104:12345-0@lo:400:kworker.0 Request processed in 28us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209413:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788359318.209424:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788359318.209431:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445358720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209544:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445358720:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209551:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788359318.209641:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445357952 00000100:00100000:3.0:1788359318.209647:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445357952 00000100:00100000:3.0:1788359318.209681:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788359318.209690:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445357952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209724:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445357952:12345-0@lo:400:kworker.0 Request processed in 36us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.209730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788359318.209768:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359318.209771:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359318.209851:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445358080:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.209868:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445358592:0@lo:400:kworker.0 00010000:00080000:3.0:1788359318.209893:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7594380 x1875230445359104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359318.209903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445359104:0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.209919:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359318.209936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445359360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359318.209983:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359318.210042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.210046:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359360 00000100:00100000:3.0:1788359318.210053:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359360 00000100:00100000:1.0:1788359318.210098:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445357952:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.210106:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788359318.210118:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445359360:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359318.210122:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445358464:0@lo:400:kworker.0 00002000:00000024:3.0:1788359318.210144:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359318.210199:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445359360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.210205:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788359318.210225:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358976 00000100:00100000:1.0:1788359318.210234:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358976 00000100:00100000:1.0:1788359318.210284:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788359318.210293:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445358976:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788359318.210326:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eac12aea00 x1875230445359360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359318.210349:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445359360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359318.210355:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445358976:12345-0@lo:400:kworker.0 Request processed in 59us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359318.210365:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788359318.210385:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359318.210394:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359318.210400:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445358848 00000100:00100000:1.0:1788359318.210407:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445358848 00000100:00080000:3.0:1788359318.210440:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359318.210726:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359232 00000100:00100000:3.0:1788359318.210733:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359232 00000100:00100000:3.0:1788359318.210768:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359318.210777:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445358848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.210838:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445358848:12345-0@lo:400:kworker.0 Request processed in 62us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.210855:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359318.210871:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359318.210876:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445359232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.210905:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445359232:12345-0@lo:400:kworker.0 Request processed in 28us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.210909:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788359318.212683:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445358208:0@lo:400:kworker.0 00000100:00100000:3.0:1788359318.212701:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359318.212725:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445359488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359318.212776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359318.212842:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359488 00000100:00100000:3.0:1788359318.212849:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359488 00010000:00080000:2.0:1788359318.212888:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7595c00 x1875230445358720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359318.212899:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788359318.212918:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445359488:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359318.212921:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788359318.212931:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445358976:0@lo:400:kworker.0 00010000:00080000:2.0:1788359318.212941:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7595180 x1875230445359232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788359318.212942:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359318.213005:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445359488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359318.213015:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788359318.213056:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693f100 x1875230445359488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359318.213073:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445359488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359318.213684:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445359232:0@lo:400:kworker.0 00000100:00100000:2.0:1788359318.213739:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445358336:0@lo:400:kworker.0 00010000:00080000:2.0:1788359318.213755:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7595500 x1875230445358848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359318.213765:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445358848:0@lo:400:kworker.0 00010000:00010000:1.0:1788359318.909540:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359319.936688:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359319.997923:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.997970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998008:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998117:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998141:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359319.998178:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121728 00000100:00100000:1.0:1788359319.998191:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121728 00000100:00100000:1.0:1788359319.998265:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121984 00000100:00100000:1.0:1788359319.998269:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121984 00000100:00100000:1.0:1788359319.998288:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121856 00000100:00100000:1.0:1788359319.998291:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121856 00000100:00100000:1.0:1788359319.998303:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122112 00000100:00100000:1.0:1788359319.998305:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122112 00000100:00100000:1.0:1788359319.998324:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:1.0:1788359319.998335:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420121728:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998434:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420121728:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 100us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998442:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:1.0:1788359319.998462:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:1.0:1788359319.998469:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420121984:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998523:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420121984:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998529:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:1.0:1788359319.998541:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 139 00000100:00100000:1.0:1788359319.998547:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420121856:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998570:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420121856:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998577:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 139 00000100:00100000:1.0:1788359319.998588:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 140 00000100:00100000:1.0:1788359319.998603:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122112:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998629:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122112:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998635:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 140 00000100:00100000:1.0:1788359319.998657:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122240 00000100:00100000:1.0:1788359319.998660:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122240 00000100:00100000:1.0:1788359319.998691:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122368 00000100:00100000:1.0:1788359319.998694:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122368 00000100:00100000:1.0:1788359319.998713:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:1.0:1788359319.998720:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122240:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998746:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122240:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998753:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:1.0:1788359319.998765:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:1.0:1788359319.998770:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122368:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998805:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2404:x1875230420122368:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998811:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:1.0:1788359319.998831:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420121600 00000100:00100000:1.0:1788359319.998835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420121600 00000100:00100000:1.0:1788359319.998867:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 302 00000100:00100000:1.0:1788359319.998874:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420121600:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359319.998899:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420121600:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359319.998906:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 302 00000100:00080000:1.0:1788359319.998956:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359319.998961:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359319.998965:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359319.998966:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788359320.683012:0:12189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788359320.766891:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445359616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359320.767000:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359320.767116:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359616 00000100:00100000:3.0:1788359320.767126:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359616 00000100:00100000:3.0:1788359320.767189:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788359320.767210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445359616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359320.767257:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359320.768544:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445359616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1326us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359320.768560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788359320.768657:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445359616:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788359320.770375:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00100000:3.0:1788359320.773442:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00100000:3.0:1788359320.777379:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00100000:3.0:1788359320.783042:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00010000:00010000:2.0:1788359320.957002:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359321.277123:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359321.277159:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445359744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359321.277263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359321.277319:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359744 00000100:00100000:3.0:1788359321.277331:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359744 00000100:00100000:3.0:1788359321.277404:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788359321.277415:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445359744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359321.277463:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359321.277721:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445359744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 307us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359321.277730:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788359321.277955:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445359744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359321.996394:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359323.006089:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359323.339093:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359323.339192:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339625:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445360000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359323.339664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339692:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445360512:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.339722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339755:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445361024:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.339784:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339833:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445361536:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.339857:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339878:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788359323.339884:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445360128:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.339916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339941:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445360640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.339967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.339985:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445361152:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.340147:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445359872 00000100:00100000:3.0:1788359323.340156:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445359872 00000100:00100000:3.0:1788359323.340219:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360000 00000100:00100000:3.0:1788359323.340223:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360000 00000100:00100000:3.0:1788359323.340244:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788359323.340254:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445359872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788359323.340295:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359323.340344:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445359872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340352:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788359323.340372:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788359323.340379:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445360000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359323.340395:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359323.340427:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445360000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340433:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788359323.340526:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360512 00000100:00100000:3.0:1788359323.340538:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360512 00000100:00100000:3.0:1788359323.340568:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361152 00000100:00100000:3.0:1788359323.340571:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361152 00000100:00100000:3.0:1788359323.340592:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788359323.340598:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445360512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340633:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445360512:12345-0@lo:400:kworker.0 Request processed in 35us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340639:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788359323.340649:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788359323.340654:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445361152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340677:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445361152:12345-0@lo:400:kworker.0 Request processed in 22us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340682:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788359323.340699:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361024 00000100:00100000:3.0:1788359323.340702:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361024 00000100:00100000:3.0:1788359323.340724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361536 00000100:00100000:3.0:1788359323.340727:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361536 00000100:00100000:3.0:1788359323.340741:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359323.340760:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445361024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340790:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445361024:12345-0@lo:400:kworker.0 Request processed in 31us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340796:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359323.340806:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359323.340811:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445361536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340837:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445361536:12345-0@lo:400:kworker.0 Request processed in 25us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340843:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359323.340875:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360128 00000100:00100000:3.0:1788359323.340880:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360128 00000100:00100000:3.0:1788359323.340909:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788359323.340916:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445360128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.340949:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445360128:12345-0@lo:400:kworker.0 Request processed in 34us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.340955:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788359323.340987:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360640 00000100:00100000:3.0:1788359323.340991:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360640 00000100:00100000:3.0:1788359323.344219:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788359323.344246:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445360640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.344370:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445360640:12345-0@lo:400:kworker.0 Request processed in 136us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.344379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788359323.344420:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359323.344429:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359323.344433:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359323.344484:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445360128:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.344533:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445360640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.344552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445361152:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.344573:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7595180 x1875230445360000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.344595:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7595180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445360000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359323.344613:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445360512:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.344627:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff6300 x1875230445361024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.344654:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445361024:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.344670:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6375500 x1875230445361536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.344679:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445361536:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.344724:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359323.344738:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445361664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359323.347208:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.347333:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361664 00000100:00100000:3.0:1788359323.347345:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361664 00000100:00100000:3.0:1788359323.347411:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788359323.347421:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445361664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359323.347452:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359323.347544:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445361664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.347551:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788359323.347574:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788359323.347612:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7394a80 x1875230445361664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.347634:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445361664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359323.347667:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445360256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.347703:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.347724:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445360768:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.347757:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359323.351860:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445360384:0@lo:400:kworker.0 00000100:00100000:2.0:1788359323.351963:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359323.352023:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445360896:0@lo:400:kworker.0 00000100:00100000:2.0:1788359323.352055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359323.352079:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445361408:0@lo:400:kworker.0 00000100:00100000:2.0:1788359323.352105:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788359323.352154:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7596d80 x1875230445359872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359323.352185:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445359872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359323.352702:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445361280:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.352755:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.352784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445361792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359323.352822:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359323.352864:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360256 00000100:00100000:3.0:1788359323.352872:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360256 00000100:00100000:3.0:1788359323.352920:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360768 00000100:00100000:3.0:1788359323.352924:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360768 00000100:00100000:3.0:1788359323.352950:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360896 00000100:00100000:3.0:1788359323.352953:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360896 00000100:00100000:3.0:1788359323.352966:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361280 00000100:00100000:3.0:1788359323.352968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361280 00000100:00100000:3.0:1788359323.352983:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788359323.352991:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445360256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445360256:12345-0@lo:400:kworker.0 Request processed in 79us (5367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788359323.353096:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788359323.353102:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445360768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353131:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445360768:12345-0@lo:400:kworker.0 Request processed in 30us (5374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788359323.353147:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788359323.353153:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445360896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445360896:12345-0@lo:400:kworker.0 Request processed in 39us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353198:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788359323.353228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788359323.353234:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445361280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445361280:12345-0@lo:400:kworker.0 Request processed in 36us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353276:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788359323.353304:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361408 00000100:00100000:3.0:1788359323.353308:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361408 00000100:00100000:3.0:1788359323.353333:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359323.353339:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445361408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353372:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445361408:12345-0@lo:400:kworker.0 Request processed in 34us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353378:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359323.353398:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361792 00000100:00100000:3.0:1788359323.353401:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361792 00000100:00100000:3.0:1788359323.353426:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788359323.353433:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445361792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359323.353450:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359323.353484:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445361792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359323.353490:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788359323.353540:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359323.353545:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788359323.353574:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff7b80 x1875230445360896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.353587:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445360896:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.353600:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6374000 x1875230445361408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.353618:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445361408:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353667:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445360256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359323.353680:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445360768:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.353691:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6377800 x1875230445361280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.353700:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445361280:0@lo:400:kworker.0 00010000:00080000:3.0:1788359323.353709:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7597100 x1875230445361792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359323.353722:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445361792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359323.360026:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445360384 00000100:00100000:1.0:1788359323.360049:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445360384 00000100:00100000:1.0:1788359323.360361:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788359323.360375:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359323.360611:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445360384:12345-0@lo:400:kworker.0 Request processed in 239us (8648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359323.360619:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788359323.361483:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445360384:0@lo:400:kworker.0 00010000:00010000:2.0:1788359324.032457:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359325.054632:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359325.117918:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.117989:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118017:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118044:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118067:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118086:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359325.118204:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122752 00000100:00100000:2.0:1788359325.118216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122752 00000100:00100000:2.0:1788359325.118290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123008 00000100:00100000:2.0:1788359325.118293:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123008 00000100:00100000:2.0:1788359325.118313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122624 00000100:00100000:2.0:1788359325.118316:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122624 00000100:00100000:2.0:1788359325.118328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122880 00000100:00100000:2.0:1788359325.118330:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122880 00000100:00100000:2.0:1788359325.118349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 147 00000100:00100000:2.0:1788359325.118359:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420122752:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118461:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420122752:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 102us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 147 00000100:00100000:2.0:1788359325.118527:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 148 00000100:00100000:2.0:1788359325.118536:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420123008:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118563:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420123008:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118570:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 148 00000100:00100000:2.0:1788359325.118583:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 149 00000100:00100000:2.0:1788359325.118589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420122624:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118615:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420122624:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 149 00000100:00100000:2.0:1788359325.118646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 150 00000100:00100000:2.0:1788359325.118653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420122880:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118681:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420122880:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 150 00000100:00100000:2.0:1788359325.118716:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123264 00000100:00100000:2.0:1788359325.118720:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123264 00000100:00100000:2.0:1788359325.118762:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123136 00000100:00100000:2.0:1788359325.118765:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123136 00000100:00100000:2.0:1788359325.118783:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:2.0:1788359325.118789:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420123264:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118816:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420123264:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118822:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:2.0:1788359325.118833:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:2.0:1788359325.118839:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420123136:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359325.118862:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420123136:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359325.118868:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00080000:2.0:1788359325.118897:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359325.118902:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359325.118905:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359325.118907:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359325.119413:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420122496 00000100:00100000:0.0:1788359325.119421:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420122496 00000100:00100000:0.0:1788359325.119474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 304 00000100:00100000:0.0:1788359325.119483:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420122496:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359325.119560:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420122496:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 77us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359325.119568:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 304 00000100:00100000:3.0:1788359325.885636:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359325.885662:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445361920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359325.885745:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359325.885824:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445361920 00000100:00100000:3.0:1788359325.885834:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445361920 00000100:00100000:3.0:1788359325.885890:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788359325.885899:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445361920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359325.885935:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359325.885981:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445361920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359325.885988:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788359325.886035:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445361920:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359326.079200:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359326.397995:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445362048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359326.398090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359326.398408:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362048 00000100:00100000:3.0:1788359326.398424:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362048 00000100:00100000:3.0:1788359326.398480:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788359326.398490:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445362048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359326.399007:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359326.399075:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445362048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 585us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359326.399082:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788359326.399171:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445362048:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359327.100941:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359328.127610:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359328.444711:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359328.444746:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445362176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359328.444839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.445645:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362176 00000100:00100000:3.0:1788359328.445657:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362176 00000100:00100000:3.0:1788359328.445735:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788359328.445749:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445362176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788359328.445785:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359328.445845:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445362176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.445853:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788359328.445997:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359328.446015:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445362304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359328.446048:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446079:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445362816:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446145:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446165:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445363328:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446219:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445363840:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446260:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788359328.446264:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445362432:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446327:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445362944:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446365:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445363456:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446381:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.446408:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362304 00000100:00100000:3.0:1788359328.446412:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362304 00000100:00100000:3.0:1788359328.446450:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359328.446456:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445362304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359328.446473:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359328.446531:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445362304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446537:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359328.446556:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362816 00000100:00100000:3.0:1788359328.446560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362816 00000100:00100000:3.0:1788359328.446584:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363456 00000100:00100000:3.0:1788359328.446586:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363456 00000100:00100000:3.0:1788359328.446607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788359328.446613:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445362816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445362816:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788359328.446665:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788359328.446671:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445363456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446711:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445363456:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446726:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788359328.446745:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363328 00000100:00100000:3.0:1788359328.446748:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363328 00000100:00100000:3.0:1788359328.446773:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363840 00000100:00100000:3.0:1788359328.446775:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363840 00000100:00100000:3.0:1788359328.446790:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788359328.446795:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445363328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446826:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445363328:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446832:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788359328.446843:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788359328.446848:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445363840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446871:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445363840:12345-0@lo:400:kworker.0 Request processed in 23us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446877:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788359328.446897:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362432 00000100:00100000:3.0:1788359328.446900:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362432 00000100:00100000:3.0:1788359328.446925:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788359328.446930:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445362432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.446958:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445362432:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.446964:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788359328.446993:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362944 00000100:00100000:3.0:1788359328.446996:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362944 00000100:00100000:3.0:1788359328.447019:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788359328.447025:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445362944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447067:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445362944:12345-0@lo:400:kworker.0 Request processed in 41us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447073:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788359328.447113:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445362688:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447138:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447156:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445363200:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447194:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445363712:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447232:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788359328.447237:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445362560:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447256:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447271:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445363072:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447305:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445363584:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359328.447347:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362688 00000100:00100000:3.0:1788359328.447351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362688 00000100:00100000:3.0:1788359328.447373:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788359328.447378:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445362688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447413:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445362688:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788359328.447436:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363200 00000100:00100000:3.0:1788359328.447439:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363200 00000100:00100000:3.0:1788359328.447468:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445362560 00000100:00100000:3.0:1788359328.447471:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445362560 00000100:00100000:3.0:1788359328.447483:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363072 00000100:00100000:3.0:1788359328.447485:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363072 00000100:00100000:3.0:1788359328.447515:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363584 00000100:00100000:3.0:1788359328.447518:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363584 00000100:00100000:3.0:1788359328.447535:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788359328.447540:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445363200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447572:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445363200:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447578:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788359328.447591:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788359328.447598:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445362560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447625:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445362560:12345-0@lo:400:kworker.0 Request processed in 28us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447630:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788359328.447644:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788359328.447649:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445363072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447672:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445363072:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447678:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788359328.447688:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788359328.447705:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445363584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447731:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445363584:12345-0@lo:400:kworker.0 Request processed in 38us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447737:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1788359328.447758:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359328.447767:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359328.447769:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359328.447771:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359328.447802:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363712 00000100:00100000:3.0:1788359328.447806:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363712 00000100:00100000:3.0:1788359328.447832:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788359328.447839:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445363712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447869:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445363712:12345-0@lo:400:kworker.0 Request processed in 31us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359328.447875:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788359328.447890:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788359328.447922:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7597100 x1875230445362176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.447944:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445362176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359328.447981:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445362560:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.447992:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445363072:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448001:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c55a5180 x1875230445363584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448010:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445363584:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.448019:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445362688:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448026:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693f100 x1875230445363200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448033:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445363200:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c55a5880 x1875230445363712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448056:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445363712:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.448089:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445362432:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.448098:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445362944:0@lo:400:kworker.0 00000100:00100000:3.0:1788359328.448108:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445363456:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448118:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff7800 x1875230445362304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448128:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445362304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359328.448137:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445362816:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448146:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693ca80 x1875230445363328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448154:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445363328:0@lo:400:kworker.0 00010000:00080000:3.0:1788359328.448164:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c55a4700 x1875230445363840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359328.448172:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445363840:0@lo:400:kworker.0 00000100:00100000:0.0:1788359328.450311:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445364096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359328.450367:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359328.450442:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364096 00000100:00100000:2.0:1788359328.450449:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364096 00000100:00100000:2.0:1788359328.450491:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788359328.450518:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb00b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445364096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359328.450537:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359328.450578:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb00b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445364096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359328.450585:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788359328.450778:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7653b80 x1875230445364096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359328.450794:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7653b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445364096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359328.452273:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445363968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359328.452325:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359328.462846:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445363968 00000100:00100000:0.0:1788359328.462861:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445363968 00000100:00100000:0.0:1788359328.462913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788359328.462924:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445363968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359328.462949:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359328.463031:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445363968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (10705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359328.463038:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788359328.463205:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eac12ad880 x1875230445363968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359328.463226:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445363968:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788359329.148821:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788359329.182888:0:12505:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359329.183124:0:12505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788359330.183942:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359330.235111:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235183:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235215:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235247:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235273:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235291:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235315:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359330.235342:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124160 00000100:00100000:2.0:1788359330.235351:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124160 00000100:00100000:2.0:1788359330.235400:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124032 00000100:00100000:2.0:1788359330.235404:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124032 00000100:00100000:2.0:1788359330.235426:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:2.0:1788359330.235436:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124160:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235557:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124160:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235566:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:2.0:1788359330.235582:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:2.0:1788359330.235588:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124032:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235613:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124032:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235619:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:2.0:1788359330.235637:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123648 00000100:00100000:2.0:1788359330.235640:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123648 00000100:00100000:2.0:1788359330.235685:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123904 00000100:00100000:2.0:1788359330.235688:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123904 00000100:00100000:2.0:1788359330.235704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123520 00000100:00100000:2.0:1788359330.235706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123520 00000100:00100000:2.0:1788359330.235718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123776 00000100:00100000:2.0:1788359330.235720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123776 00000100:00100000:2.0:1788359330.235735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:2.0:1788359330.235741:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420123648:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235770:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420123648:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235776:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:2.0:1788359330.235786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:2.0:1788359330.235791:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420123904:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235807:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420123904:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 16us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235818:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:2.0:1788359330.235826:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:2.0:1788359330.235829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420123520:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420123520:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 16us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235848:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:2.0:1788359330.235854:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 160 00000100:00100000:2.0:1788359330.235857:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420123776:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359330.235877:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420123776:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 19us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359330.235883:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 160 00000100:00100000:3.0:1788359330.236104:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420123392 00000100:00100000:3.0:1788359330.236109:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420123392 00000100:00100000:3.0:1788359330.236159:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 306 00000100:00100000:3.0:1788359330.236168:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420123392:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359330.236226:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420123392:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 59us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359330.236233:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 306 00000100:00080000:3.0:1788359330.236266:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359330.236270:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359330.236272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359330.236274:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359331.005062:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445364224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359331.005194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359331.005805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364224 00000100:00100000:2.0:1788359331.005815:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364224 00000100:00100000:2.0:1788359331.005865:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788359331.005873:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445364224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359331.005909:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359331.005977:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445364224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359331.005984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788359331.006076:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445364224:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359331.198865:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359331.522967:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359331.522996:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445364352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359331.523080:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359331.523151:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364352 00000100:00100000:3.0:1788359331.523159:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364352 00000100:00100000:3.0:1788359331.523224:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788359331.523233:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445364352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359331.523269:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359331.523357:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445364352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359331.523365:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788359331.523415:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445364352:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788359331.820936:0:12604:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359331.821657:0:12604:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788359332.220826:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359333.251767:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359333.565108:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445364480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359333.565268:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.565366:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364480 00000100:00100000:1.0:1788359333.565375:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364480 00000100:00100000:1.0:1788359333.565428:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788359333.565439:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445364480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359333.565470:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359333.565547:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445364480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.565555:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788359333.565578:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788359333.565665:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead2750700 x1875230445364480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359333.565685:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445364480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359333.570103:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445364608:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570221:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445365248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359333.570249:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445365632:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570320:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366144:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570374:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788359333.570382:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570425:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445365120:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570448:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570465:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445365760:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570526:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359333.570544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359333.570573:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365248 00000100:00100000:0.0:1788359333.570579:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365248 00000100:00100000:0.0:1788359333.570626:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366272 00000100:00100000:0.0:1788359333.570629:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366272 00000100:00100000:0.0:1788359333.570661:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788359333.570671:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445365248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359333.570712:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359333.570758:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445365248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.570765:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788359333.570784:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788359333.570791:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788359333.570802:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359333.570827:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.570832:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788359333.570850:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365632 00000100:00100000:0.0:1788359333.570854:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365632 00000100:00100000:0.0:1788359333.570877:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366144 00000100:00100000:0.0:1788359333.570880:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366144 00000100:00100000:0.0:1788359333.570889:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365760 00000100:00100000:0.0:1788359333.570891:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365760 00000100:00100000:0.0:1788359333.570904:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788359333.570910:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445365632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570942:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445365632:12345-0@lo:400:kworker.0 Request processed in 31us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.570947:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788359333.570958:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788359333.570964:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.570989:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366144:12345-0@lo:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.570995:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788359333.571014:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788359333.571019:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445365760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.571047:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445365760:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.571053:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788359333.571076:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364736 00000100:00100000:0.0:1788359333.571079:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364736 00000100:00100000:0.0:1788359333.571104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788359333.571111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445364736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.571142:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445364736:12345-0@lo:400:kworker.0 Request processed in 31us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.571148:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788359333.571165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365120 00000100:00100000:0.0:1788359333.571168:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365120 00000100:00100000:0.0:1788359333.571191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788359333.571197:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445365120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.571227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445365120:12345-0@lo:400:kworker.0 Request processed in 30us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359333.571233:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788359333.571281:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788359333.571291:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445365120:0@lo:400:kworker.0 00010000:00080000:0.0:1788359333.571303:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693dc00 x1875230445365760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359333.571314:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445365760:0@lo:400:kworker.0 00010000:00080000:0.0:1788359333.571324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eac12ad880 x1875230445366272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359333.571345:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366272:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788359333.571358:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7650700 x1875230445365248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359333.571369:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7650700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445365248:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788359333.571379:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693c000 x1875230445365632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359333.571388:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445365632:0@lo:400:kworker.0 00010000:00080000:0.0:1788359333.571397:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693c700 x1875230445366144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359333.571406:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366144:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.571751:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445364864:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.571784:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.571806:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445365376:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.571866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.571887:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445365888:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.571907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.571925:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445366400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359333.571947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.571966:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788359333.571973:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445364992:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.571994:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.572010:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445365504:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.572052:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445366016:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359333.572107:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365376 00000100:00100000:1.0:1788359333.572111:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365376 00000100:00100000:1.0:1788359333.572136:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365888 00000100:00100000:1.0:1788359333.572138:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365888 00000100:00100000:1.0:1788359333.572150:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364992 00000100:00100000:1.0:1788359333.572152:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364992 00000100:00100000:1.0:1788359333.572162:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445365504 00000100:00100000:1.0:1788359333.572164:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445365504 00000100:00100000:1.0:1788359333.572175:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366016 00000100:00100000:1.0:1788359333.572177:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366016 00000100:00100000:1.0:1788359333.572188:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788359333.572194:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445365376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572230:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445365376:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572236:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788359333.572247:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788359333.572253:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445365888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572274:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445365888:12345-0@lo:400:kworker.0 Request processed in 22us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572280:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788359333.572289:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788359333.572293:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445364992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572326:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445364992:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572341:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788359333.572352:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788359333.572357:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445365504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572382:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445365504:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572386:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788359333.572394:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788359333.572399:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445366016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572418:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445366016:12345-0@lo:400:kworker.0 Request processed in 19us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572423:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788359333.572447:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359333.572451:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788359333.572453:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359333.572454:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359333.572465:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366400 00000100:00100000:1.0:1788359333.572468:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366400 00000100:00100000:1.0:1788359333.572489:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788359333.572528:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445366400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359333.572542:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359333.572570:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445366400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359333.572576:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788359333.572614:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445364992:0@lo:400:kworker.0 00010000:00080000:1.0:1788359333.572625:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693e680 x1875230445365504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359333.572659:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445365504:0@lo:400:kworker.0 00010000:00080000:1.0:1788359333.572672:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693d180 x1875230445366016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359333.572680:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445366016:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572689:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445365376:0@lo:400:kworker.0 00000100:00100000:1.0:1788359333.572697:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445365888:0@lo:400:kworker.0 00010000:00080000:1.0:1788359333.572705:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead2750700 x1875230445366400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359333.572717:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445366400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359333.572998:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364608 00000100:00100000:3.0:1788359333.573003:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364608 00000100:00100000:3.0:1788359333.573033:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788359333.573040:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445364608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359333.573099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445364608:12345-0@lo:400:kworker.0 Request processed in 59us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359333.573112:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788359333.573145:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445364864 00000100:00100000:3.0:1788359333.573151:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445364864 00000100:00100000:3.0:1788359333.573176:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788359333.573181:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359333.573217:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445364864:12345-0@lo:400:kworker.0 Request processed in 36us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359333.573223:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788359333.573254:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445364864:0@lo:400:kworker.0 00000100:00100000:3.0:1788359333.573276:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445364608:0@lo:400:kworker.0 00010000:00010000:1.0:1788359334.269006:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359335.009411:0:12701:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359335.010242:0:12701:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788359335.292648:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359335.358665:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359335.358706:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359335.358733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359335.358751:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359335.358793:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359335.358812:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124416 00000100:00100000:0.0:1788359335.358824:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124416 00000100:00100000:0.0:1788359335.358945:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124672 00000100:00100000:3.0:1788359335.358949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124288 00000100:00100000:0.0:1788359335.358950:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124672 00000100:00100000:3.0:1788359335.358957:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124288 00000100:00080000:2.0:1788359335.358980:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359335.359008:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124544 00000100:00100000:1.0:1788359335.359013:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124544 00000100:00100000:2.0:1788359335.359035:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 308 00000100:00100000:1.0:1788359335.359041:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124800 00000100:00100000:1.0:1788359335.359045:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124800 00000100:00100000:2.0:1788359335.359050:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420124288:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359335.359066:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 167 00000100:00100000:1.0:1788359335.359073:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420124416:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359335.359184:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420124288:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 139us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359335.359193:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 308 00000100:00100000:1.0:1788359335.359233:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420124416:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 157us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359335.359243:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 167 00000100:00100000:1.0:1788359335.359268:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 168 00000100:00100000:1.0:1788359335.359276:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420124544:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359335.359313:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420124544:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359335.359320:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 168 00000100:00100000:1.0:1788359335.359333:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 169 00000100:00100000:1.0:1788359335.359340:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124800:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359335.359375:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124800:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 35us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359335.359382:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 169 00000100:00100000:0.0:1788359335.359472:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 170 00000100:00100000:0.0:1788359335.359481:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124672:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359335.359545:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420124672:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 66us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359335.359552:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 170 00000100:00080000:1.0:1788359335.359692:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359335.363935:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359335.363982:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359335.364233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420124928 00000100:00100000:2.0:1788359335.364244:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420124928 00000100:00100000:2.0:1788359335.364330:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125056 00000100:00080000:1.0:1788359335.364330:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359335.364335:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125056 00000100:00080000:1.0:1788359335.364355:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359335.364390:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:2.0:1788359335.364400:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2401:x1875230420124928:12345-192.168.202.52@tcp:9:kworker.0 00000020:00000080:2.0:1788359335.364433:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae595 00000100:00080000:2.0:1788359335.364443:0:8431:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6353800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788359335.364522:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788359335.364537:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788359335.364755:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+2:2401:x1875230420124928:12345-192.168.202.52@tcp:9:kworker.0 Request processed in 355us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359335.364763:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:2.0:1788359335.364780:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:2.0:1788359335.364787:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2401:x1875230420125056:12345-192.168.202.52@tcp:9:kworker.0 00000020:00000080:2.0:1788359335.364801:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae59c 00000100:00080000:2.0:1788359335.364807:0:8431:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6355800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788359335.364834:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788359335.364931:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+2:2401:x1875230420125056:12345-192.168.202.52@tcp:9:kworker.0 Request processed in 145us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359335.364954:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00010000:00010000:2.0:1788359335.364979:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359336.126069:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359336.126095:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445366528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359336.126165:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359336.126273:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366528 00000100:00100000:2.0:1788359336.126282:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366528 00000100:00100000:2.0:1788359336.126338:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788359336.126347:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445366528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359336.126378:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359336.126433:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445366528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359336.126441:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788359336.126701:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445366528:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359336.317215:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359336.639188:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359336.639216:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445366656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359336.639292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359336.639604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366656 00000100:00100000:3.0:1788359336.639624:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366656 00000100:00100000:3.0:1788359336.639687:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788359336.639698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445366656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359336.639732:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359336.639793:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445366656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359336.639801:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788359336.640139:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445366656:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788359337.272666:0:12798:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359337.273004:0:12798:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788359337.341728:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359338.364860:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359338.684720:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359338.684741:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359338.684809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359338.684854:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366784 00000100:00100000:3.0:1788359338.684888:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366784 00000100:00100000:3.0:1788359338.684999:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788359338.685016:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366784:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359338.685017:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359338.685037:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445366912:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359338.685079:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359338.685092:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359338.685207:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445366784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359338.685216:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788359338.685236:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445366912 00000100:00100000:3.0:1788359338.685240:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445366912 00000100:00100000:3.0:1788359338.685271:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788359338.685279:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445366912:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788359338.685296:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bfb80 x1875230445366784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1788359338.685300:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359338.685329:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445366784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359338.685359:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7651f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445366912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359338.685369:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788359338.685393:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7651180 x1875230445366912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359338.685409:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445366912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359338.685686:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445367424:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.685735:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.685754:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445367936:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.685775:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.685798:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788359338.685803:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445367040:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.685826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.685843:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445367552:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.685863:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.685892:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445368064:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.685910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.685941:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367424 00000100:00100000:3.0:1788359338.686007:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367040 00000100:00100000:3.0:1788359338.686014:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367040 00000100:00100000:3.0:1788359338.686062:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788359338.686070:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445367040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686361:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367424 00000100:00100000:3.0:1788359338.686383:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445367040:12345-0@lo:400:kworker.0 Request processed in 312us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359338.686393:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788359338.686421:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368064 00000100:00100000:1.0:1788359338.686427:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368064 00000100:00100000:3.0:1788359338.686456:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445367296:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686467:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788359338.686483:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445367424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686562:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445367424:12345-0@lo:400:kworker.0 Request processed in 85us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359338.686571:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788359338.686589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788359338.686607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445368064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445368064:12345-0@lo:400:kworker.0 Request processed in 40us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359338.686641:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788359338.686662:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367936 00000100:00100000:1.0:1788359338.686665:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367936 00000100:00100000:1.0:1788359338.686700:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788359338.686710:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.686720:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445367936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.686752:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445367808:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686770:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445367936:12345-0@lo:400:kworker.0 Request processed in 53us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359338.686780:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788359338.686797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.686814:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359338.686828:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445368448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359338.686842:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445368320:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.686871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359338.686885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359338.686930:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445367040:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.686936:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788359338.686949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445367168:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.686975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359338.686997:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445367680:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.687019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359338.687173:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359338.687182:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788359338.687186:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359338.687202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367552 00000100:00100000:0.0:1788359338.687209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367552 00000100:00100000:0.0:1788359338.687246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367296 00000100:00100000:0.0:1788359338.687249:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367296 00000100:00100000:0.0:1788359338.687262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788359338.687270:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445367552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359338.687318:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445367552:12345-0@lo:400:kworker.0 Request processed in 47us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359338.687324:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788359338.687339:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788359338.687345:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445367296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359338.687381:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445367296:12345-0@lo:400:kworker.0 Request processed in 36us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359338.687391:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788359338.687418:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367808 00000100:00100000:0.0:1788359338.687424:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367808 00000100:00100000:2.0:1788359338.687445:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367168 00000100:00100000:2.0:1788359338.687452:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367168 00000100:00100000:0.0:1788359338.687468:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445367680 00000100:00100000:0.0:1788359338.687473:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445367680 00000100:00100000:2.0:1788359338.687516:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788359338.687527:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445367808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359338.687572:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445367808:12345-0@lo:400:kworker.0 Request processed in 48us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359338.687579:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788359338.687606:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788359338.687613:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445367168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359338.687644:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445367168:12345-0@lo:400:kworker.0 Request processed in 32us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359338.687650:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788359338.687668:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368320 00000100:00100000:2.0:1788359338.687672:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368320 00000100:00100000:2.0:1788359338.687702:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359338.687708:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445368320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359338.687739:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445368320:12345-0@lo:400:kworker.0 Request processed in 31us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359338.687745:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359338.687763:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445368576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359338.687791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359338.687825:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368448 00000100:00100000:2.0:1788359338.687829:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368448 00000100:00100000:2.0:1788359338.687849:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368576 00000100:00100000:2.0:1788359338.687851:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368576 00000100:00100000:2.0:1788359338.687863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788359338.687867:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445368448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359338.687879:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359338.687916:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445368448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359338.687927:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788359338.687961:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788359338.687971:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445367680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359338.688017:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445367680:12345-0@lo:400:kworker.0 Request processed in 48us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359338.688052:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1788359338.688085:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359338.688088:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788359338.688091:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359338.688200:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788359338.688215:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445368576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359338.688231:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359338.688267:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445368576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359338.688273:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788359338.688309:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7651180 x1875230445368576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359338.688325:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445368576:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788359338.688337:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c693ce00 x1875230445368448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359338.688347:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445368448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359338.688839:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445367680:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.688854:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445368192:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.688899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359338.689721:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368192 00000100:00100000:0.0:1788359338.689732:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368192 00000100:00100000:0.0:1788359338.689820:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788359338.689830:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445368192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788359338.689909:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359338.691883:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445367552:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.691909:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445368064:0@lo:400:kworker.0 00000100:00100000:1.0:1788359338.691922:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445367424:0@lo:400:kworker.0 00010000:00080000:1.0:1788359338.691939:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c6300 x1875230445367936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359338.691950:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445367936:0@lo:400:kworker.0 00000100:00100000:0.0:1788359338.692920:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445368192:12345-0@lo:400:kworker.0 Request processed in 3075us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359338.692939:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788359338.695708:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445367296:0@lo:400:kworker.0 00010000:00080000:3.0:1788359338.695742:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c4700 x1875230445367808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359338.695755:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445367808:0@lo:400:kworker.0 00010000:00080000:3.0:1788359338.695769:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7530700 x1875230445368320/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359338.695778:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445368320:0@lo:400:kworker.0 00000100:00100000:3.0:1788359338.695830:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445367168:0@lo:400:kworker.0 00010000:00080000:3.0:1788359338.695844:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaff0c4380 x1875230445368192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359338.695852:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445368192:0@lo:400:kworker.0 00010000:00010000:2.0:1788359339.391312:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788359339.544268:0:12896:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359339.544834:0:12896:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788359340.412655:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359340.475795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359340.475849:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359340.475874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359340.475895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359340.475919:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359340.475949:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125440 00000100:00100000:3.0:1788359340.475959:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125440 00000100:00100000:3.0:1788359340.476011:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125696 00000100:00100000:3.0:1788359340.476014:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125696 00000100:00100000:3.0:1788359340.476029:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125312 00000100:00100000:3.0:1788359340.476031:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125312 00000100:00100000:3.0:1788359340.476041:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125568 00000100:00100000:3.0:1788359340.476043:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125568 00000100:00100000:3.0:1788359340.476058:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 177 00000100:00100000:3.0:1788359340.476066:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420125440:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359340.476165:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420125440:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359340.476173:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 177 00000100:00100000:3.0:1788359340.476190:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 178 00000100:00100000:3.0:1788359340.476196:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420125696:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359340.476218:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420125696:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359340.476224:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 178 00000100:00100000:3.0:1788359340.476234:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:3.0:1788359340.476239:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420125312:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359340.476274:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420125312:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359340.476280:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:3.0:1788359340.476290:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00100000:3.0:1788359340.476295:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420125568:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359340.476316:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420125568:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 21us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359340.476321:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00080000:3.0:1788359340.476342:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359340.476346:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359340.476847:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125184 00000100:00100000:0.0:1788359340.476854:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125184 00000100:00100000:0.0:1788359340.476894:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 310 00000100:00100000:0.0:1788359340.476901:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420125184:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359340.476933:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420125184:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 33us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359340.476940:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 310 00000001:00100000:3.0:1788359340.742710:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000020:00000080:3.0:1788359340.742720:0:9510:0:(genops.c:906:class_export_put()) final put ffffa0e9c6354800/eacee332-d1ce-4046-a685-c3d51a3ce37d 00000020:00000080:2.0:1788359340.742788:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6354800/eacee332-d1ce-4046-a685-c3d51a3ce37d for lustre-OST0001 00000020:00000080:2.0:1788359340.742844:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c6355800 for lustre-OST0001 00000001:00100000:1.0:1788359340.745901:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000020:00000080:1.0:1788359340.745911:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0e9c6356000/eacee332-d1ce-4046-a685-c3d51a3ce37d 00000020:00000080:2.0:1788359340.746049:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6356000/eacee332-d1ce-4046-a685-c3d51a3ce37d for lustre-OST0000 00000020:00000080:2.0:1788359340.746109:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c6353800 for lustre-OST0000 00000100:00100000:2.0:1788359341.248773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445368704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359341.248888:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359341.249277:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368704 00000100:00100000:1.0:1788359341.249288:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368704 00000100:00100000:1.0:1788359341.249358:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788359341.249369:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445368704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359341.249418:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359341.249483:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445368704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359341.249492:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788359341.249581:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445368704:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788359341.438299:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359341.757076:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445368832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359341.757196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359341.757423:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368832 00000100:00100000:0.0:1788359341.757434:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368832 00000100:00100000:0.0:1788359341.757544:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788359341.757556:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445368832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359341.757615:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359341.757690:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445368832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359341.757698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788359341.758740:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445368832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359342.461269:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359343.484745:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359343.805840:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445368960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359343.805948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.806051:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359343.806059:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445369088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359343.806087:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.806130:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445368960 00000100:00100000:2.0:1788359343.806140:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445368960 00000100:00100000:2.0:1788359343.806206:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369088 00000100:00100000:2.0:1788359343.806209:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369088 00000100:00100000:2.0:1788359343.806231:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788359343.806240:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445368960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359343.806282:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359343.806335:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445368960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359343.806344:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788359343.806362:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788359343.806369:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445369088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359343.806380:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359343.806405:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7652d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445369088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359343.806412:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788359343.806463:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7653480 x1875230445369088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359343.806485:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7653480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445369088:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788359343.806530:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7651880 x1875230445368960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359343.806542:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7651880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445368960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788359343.807806:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359343.808479:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359343.809810:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445369216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359343.809912:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359343.809998:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369216 00000100:00100000:3.0:1788359343.810008:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369216 00000100:00100000:3.0:1788359343.810082:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788359343.810093:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445369216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359343.810136:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359343.810189:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445369216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359343.810198:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1788359343.810236:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788359343.810271:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c55a4700 x1875230445369216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359343.810295:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c55a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445369216:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359343.813978:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445369344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359343.814072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359343.814122:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445369856:0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.814151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359343.814171:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445370368:0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.814210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359343.814246:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788359343.814253:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445369728:0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.814281:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359343.814298:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445370240:0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.814321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359343.814356:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369856 00000100:00100000:0.0:1788359343.814365:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369856 00000100:00100000:0.0:1788359343.814419:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370368 00000100:00100000:0.0:1788359343.814422:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370368 00000100:00100000:0.0:1788359343.814453:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370240 00000100:00100000:0.0:1788359343.814456:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370240 00000100:00100000:0.0:1788359343.814473:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788359343.814481:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445369856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.814780:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369728 00000100:00100000:2.0:1788359343.814793:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369728 00000100:00100000:2.0:1788359343.814828:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788359343.814834:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445369728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.814888:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445369728:12345-0@lo:400:kworker.0 Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359343.814896:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788359343.814924:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369344 00000100:00100000:2.0:1788359343.814927:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369344 00000100:00100000:2.0:1788359343.814953:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788359343.814959:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445369344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788359343.814976:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359343.815007:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445369344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359343.815013:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788359343.815030:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445369600:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815059:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815073:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445370112:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815093:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815109:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445370624:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815158:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359343.815165:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445369472:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815195:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815218:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445369984:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815240:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815259:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445370496:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815291:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359343.815316:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370624 00000100:00100000:2.0:1788359343.815320:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370624 00000100:00100000:2.0:1788359343.815352:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359343.815358:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445370624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815396:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445370624:12345-0@lo:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359343.815403:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359343.815421:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369472 00000100:00100000:2.0:1788359343.815425:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369472 00000100:00100000:2.0:1788359343.815453:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788359343.815459:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445369472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.815489:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445369472:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.816702:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445369856:12345-0@lo:400:kworker.0 Request processed in 2213us (2542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.816715:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788359343.816741:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369600 00000100:00100000:0.0:1788359343.816747:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369600 00000100:00100000:0.0:1788359343.816769:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370112 00000100:00100000:0.0:1788359343.816772:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370112 00000100:00100000:0.0:1788359343.816793:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370496 00000100:00100000:0.0:1788359343.816796:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370496 00000100:00100000:0.0:1788359343.816832:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788359343.816840:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445370368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.816877:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445370368:12345-0@lo:400:kworker.0 Request processed in 38us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.816883:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788359343.816898:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788359343.816904:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445370240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.816933:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445370240:12345-0@lo:400:kworker.0 Request processed in 30us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.816939:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788359343.816950:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788359343.816956:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445369600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.816983:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445369600:12345-0@lo:400:kworker.0 Request processed in 27us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.816989:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788359343.817000:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788359343.817006:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445370112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.817031:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445370112:12345-0@lo:400:kworker.0 Request processed in 25us (1936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.817036:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788359343.817046:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788359343.817053:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445370496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359343.817079:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445370496:12345-0@lo:400:kworker.0 Request processed in 27us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359343.817084:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788359343.817131:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788359343.817138:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359343.817141:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359343.817699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445369984 00000100:00100000:3.0:1788359343.817706:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445369984 00000100:00100000:3.0:1788359343.817751:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788359343.817760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445369984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359343.817811:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445369984:12345-0@lo:400:kworker.0 Request processed in 52us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359343.817817:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788359343.817961:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445369728:0@lo:400:kworker.0 00010000:00080000:3.0:1788359343.817983:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bfb80 x1875230445370240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359343.817995:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445370240:0@lo:400:kworker.0 00010000:00080000:3.0:1788359343.818010:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74bce00 x1875230445369344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359343.818029:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445369344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359343.818044:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445369856:0@lo:400:kworker.0 00000100:00100000:3.0:1788359343.818057:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eac12ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445370368:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.818210:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788359343.818279:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445369472:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.818295:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445369984:0@lo:400:kworker.0 00010000:00080000:2.0:1788359343.818309:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27b8e00 x1875230445370496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359343.818318:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445370496:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.818330:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445369600:0@lo:400:kworker.0 00000100:00100000:2.0:1788359343.818340:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445370112:0@lo:400:kworker.0 00010000:00080000:2.0:1788359343.818350:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bbb80 x1875230445370624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359343.818375:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445370624:0@lo:400:kworker.0 00000001:02000400:3.0:1788359344.298341:0:13040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788359344.511038:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359345.534954:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359345.596791:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359345.596846:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359345.596879:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359345.596931:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359345.596967:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359345.597002:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126080 00000100:00100000:3.0:1788359345.597015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126080 00000100:00100000:3.0:1788359345.597106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126336 00000100:00100000:3.0:1788359345.597109:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126336 00000100:00100000:3.0:1788359345.597125:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125952 00000100:00100000:3.0:1788359345.597127:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125952 00000100:00100000:3.0:1788359345.597140:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126208 00000100:00100000:3.0:1788359345.597142:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126208 00000100:00100000:3.0:1788359345.597161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:3.0:1788359345.597172:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420126080:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359345.597276:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420126080:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 104us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359345.597285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:3.0:1788359345.597305:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:3.0:1788359345.597311:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420126336:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359345.597338:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420126336:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359345.597344:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:3.0:1788359345.597355:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:3.0:1788359345.597361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420125952:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359345.597383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420125952:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 22us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359345.597389:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:3.0:1788359345.597400:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00100000:3.0:1788359345.597414:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420126208:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359345.597440:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420126208:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359345.597446:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00080000:3.0:1788359345.597467:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359345.597472:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359345.598337:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420125824 00000100:00100000:0.0:1788359345.598351:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420125824 00000100:00100000:0.0:1788359345.598409:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 312 00000100:00100000:0.0:1788359345.598418:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420125824:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359345.598473:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420125824:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 55us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359345.598481:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 312 00000100:00100000:3.0:1788359346.378930:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445370752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359346.379056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359346.379312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370752 00000100:00100000:1.0:1788359346.379323:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370752 00000100:00100000:1.0:1788359346.379397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788359346.379407:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445370752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359346.379454:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359346.379550:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445370752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359346.379558:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788359346.379678:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445370752:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359346.559427:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359346.877072:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359346.877107:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445370880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359346.877207:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359346.877294:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445370880 00000100:00100000:1.0:1788359346.877303:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445370880 00000100:00100000:1.0:1788359346.877372:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788359346.877436:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445370880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359346.877489:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788359346.877597:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445370880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 214us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359346.882885:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788359346.883001:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445370880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359347.580897:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788359348.184925:0:13189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe638ed8b0 20000000:00000080:1.0:1788359348.184953:0:13189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0e9c732fc00 uarg=0000000000000000 20000000:01000000:1.0:1788359348.185013:0:13189:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788359348.185021:0:13189:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788359348.185027:0:13189:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788359348.192716:0:13190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788359348.192963:0:13189:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788359348.210188:0:13189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788359348.210237:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210262:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae533 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210272:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae541 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210280:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210288:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae55d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210329:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210337:0:13189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210345:0:13189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210411:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210433:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 12 pid: 6509 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359348.210455:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371008:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359348.210662:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210671:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 12 pid: 6510 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359348.210680:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371136:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359348.210709:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210717:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 23 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359348.210754:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371264:0@lo:104: 00000100:00100000:0.0:1788359348.210807:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359348.210848:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.210856:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359348.210864:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371392:0@lo:104: 00000100:00100000:0.0:1788359348.210886:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359348.210921:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371264 00000100:00100000:0.0:1788359348.210930:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371264 00000100:00100000:1.0:1788359348.210954:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371392 00000100:00100000:1.0:1788359348.210959:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371392 00000100:00100000:0.0:1788359348.210996:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359348.211006:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:13189:x1875230445371264:12345-0@lo:104: 00010000:00010000:0.0:1788359348.211024:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.211079:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359348.211085:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:13189:x1875230445371264:12345-0@lo:104: Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.211091:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359348.211110:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788359348.211115:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371392:12345-0@lo:104: 00010000:00010000:0.0:1788359348.211122:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359348.211154:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788359348.211165:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371392:12345-0@lo:104: Request processed in 50us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.211170:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359348.216469:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00010000:00010000:1.0:1788359348.216541:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359348.216564:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216591:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359348.216596:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216607:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216617:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 10000000:00010000:1.0:1788359348.216619:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359348.216627:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788359348.216643:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126464 00000100:00100000:3.0:1788359348.216653:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126464 00010000:00010000:3.0:1788359348.216691:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 13 pid: 6509 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216695:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216714:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126592 00010000:00010000:1.0:1788359348.216714:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788359348.216718:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126592 00010000:00010000:3.0:1788359348.216728:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 14 pid: 6510 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216747:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00010000:00010000:1.0:1788359348.216751:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216756:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+14:2404:x1875230420126464:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.216767:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feae55d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae564 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.216773:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359348.216780:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 14 pid: 6509 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216786:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359348.216794:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216802:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb600 already unused, calling callback (ffffffffc1124c20) 00010000:00010000:3.0:1788359348.216805:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 14 pid: 6509 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359348.216807:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216829:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359348.216835:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.216836:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:1.0:1788359348.216843:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788359348.216865:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216873:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359348.216880:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.216887:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb600/0x49dd053b5feae54f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae556 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216894:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+14:2404:x1875230420126464:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 139us (438us total) trans 0 rc 0/0 00010000:00010000:1.0:1788359348.216900:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359348.216903:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00010000:00010000:1.0:1788359348.216905:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359348.216909:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359348.216923:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:3.0:1788359348.216928:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420126592:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359348.216933:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359348.216937:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 13 pid: 6510 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.216944:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 13 pid: 6510 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.216951:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359348.216964:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420126592:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.216968:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00010000:00010000:1.0:1788359348.216990:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.216998:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445371520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.217008:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 23 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217024:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371776:0@lo:104: 00000100:00100000:3.0:1788359348.217051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.217070:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.217099:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359348.217109:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445371648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359348.217109:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371776 00000100:00100000:1.0:1788359348.217121:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371776 00000100:00100000:3.0:1788359348.217132:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.217159:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359348.217161:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371520 00000100:00100000:1.0:1788359348.217170:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371776:12345-0@lo:104: 00000100:00100000:3.0:1788359348.217171:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371520 00010000:00010000:1.0:1788359348.217186:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.217189:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 24 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217215:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371648 00000100:00100000:3.0:1788359348.217218:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371648 00010000:00010000:3.0:1788359348.217227:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 25 pid: 6510 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217240:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359348.217246:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3642:x1875230445371520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359348.217254:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359348.217259:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 25 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217268:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788359348.217269:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 25 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217280:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371776:12345-0@lo:104: Request processed in 112us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1788359348.217287:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359348.217288:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788359348.217321:0:13189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 25 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217324:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3642:x1875230445371520:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.217340:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788359348.217342:0:13189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 25 pid: 6509 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217354:0:13189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371904:0@lo:104: 00000100:00100000:3.0:1788359348.217358:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359348.217367:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445371648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359348.217377:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788359348.217382:0:13189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359348.217384:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 24 pid: 6510 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.217395:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 24 pid: 6510 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217404:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445371904 00000100:00100000:1.0:1788359348.217409:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445371904 00010000:00010000:3.0:1788359348.217416:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359348.217430:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788359348.217439:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371904:12345-0@lo:104: 00000100:00100000:3.0:1788359348.217443:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445371648:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.217450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1788359348.217451:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217533:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359348.217540:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13189:x1875230445371904:12345-0@lo:104: Request processed in 103us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359348.217547:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788359348.217572:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359348.217578:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217585:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359348.217589:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217597:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359348.217604:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359348.217610:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788359348.217619:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445371648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.217629:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217636:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788359348.217639:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445371520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.217659:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217668:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41400/0x49dd053b5feae541 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae548 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217671:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359348.217685:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445372032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.217687:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359348.217692:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217700:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359348.217703:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788359348.217723:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359348.217731:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359348.217737:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788359348.217757:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372032 00010000:00010000:1.0:1788359348.217758:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217762:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372032 00010000:00010000:1.0:1788359348.217768:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359348.217780:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 24 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217781:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.217799:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14b800/0x49dd053b5feae533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae53a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.217812:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788359348.217818:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359348.217821:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445372032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.217822:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359348.217826:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359348.217835:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788359348.217836:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788359348.217843:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 24 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217849:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445372160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359348.217857:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 24 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.217872:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359348.217886:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.217911:0:13189:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c480 going to sleep for 11 seconds 00010000:00010000:1.0:1788359348.217928:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a000/0x49dd053b5feae580 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dc0 expref: 12 pid: 6509 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217939:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371008:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359348.217949:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae56b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d81 expref: 11 pid: 6510 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217964:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371136:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359348.217977:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75eae00/0x49dd053b5feae564 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae55d expref: 24 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.217984:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371264:0@lo:104: 00010000:00010000:1.0:1788359348.217993:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75eb800/0x49dd053b5feae556 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae54f expref: 23 pid: 6510 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.218000:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371392:0@lo:104: 00010000:00010000:1.0:1788359348.218007:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40c00/0x49dd053b5feae548 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae541 expref: 22 pid: 6508 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359348.218015:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371776:0@lo:104: 00000100:00100000:1.0:1788359348.218020:0:13189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13189:1875230445371904:0@lo:104: 00010000:00010000:1.0:1788359348.218044:0:13189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.218078:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359348.218089:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359348.218469:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3645:x1875230445372032:12345-0@lo:103:ldlm_bl.0 Request processed in 648us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.218488:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359348.218538:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372160 00000100:00100000:3.0:1788359348.218543:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372160 00010000:00010000:3.0:1788359348.218560:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359348.218648:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788359348.218656:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3644:x1875230445372160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359348.218668:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359348.218672:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218682:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218695:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41200/0x49dd053b5feae53a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae533 expref: 21 pid: 6509 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218711:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218720:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218735:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218743:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218762:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218769:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218774:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359348.218778:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218786:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218799:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359348.218808:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359348.218921:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3644:x1875230445372160:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.218927:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788359348.218990:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445372160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359348.219149:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445372032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359348.219364:0:13189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.219374:0:13189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.219381:0:13189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b200/0x49dd053b5feae5a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359348.604962:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359348.924906:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445372416:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.924996:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925250:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445372928:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.925274:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925297:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.925314:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925328:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788359348.925334:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445372288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359348.925361:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925397:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445372800:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.925429:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445372544:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.925440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925468:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373312:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.925557:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925579:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373824:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.925596:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.925627:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372288 00000100:00100000:1.0:1788359348.925635:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372288 00000100:00100000:3.0:1788359348.925651:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.925701:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445373056:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.925734:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.925779:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445373568:0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.926362:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372416 00000100:00100000:0.0:1788359348.926370:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372416 00000100:00100000:0.0:1788359348.926423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372928 00000100:00100000:0.0:1788359348.926426:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372928 00000100:00100000:0.0:1788359348.926439:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373440 00000100:00100000:0.0:1788359348.926441:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373440 00000100:00100000:0.0:1788359348.926450:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373056 00000100:00100000:0.0:1788359348.926453:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373056 00000100:00100000:0.0:1788359348.926467:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788359348.926474:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445372416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.926565:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445372416:12345-0@lo:400:kworker.0 Request processed in 91us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.926572:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788359348.926587:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788359348.926593:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445372928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.926614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445372928:12345-0@lo:400:kworker.0 Request processed in 23us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.926620:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788359348.926628:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788359348.926632:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445373440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.926652:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445373440:12345-0@lo:400:kworker.0 Request processed in 20us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.926657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788359348.926707:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.926746:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788359348.926755:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445372672:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.926937:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788359348.926948:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445372288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359348.926971:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359348.927012:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445372288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.927082:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373568 00000100:00100000:0.0:1788359348.927087:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373568 00000100:00100000:1.0:1788359348.927298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788359348.927346:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359348.927379:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359348.927426:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788359348.927432:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445373056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.927467:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445373056:12345-0@lo:400:kworker.0 Request processed in 35us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.927473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788359348.927484:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788359348.927490:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445373568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.927546:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445373568:12345-0@lo:400:kworker.0 Request processed in 56us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.927552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788359348.927612:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373312 00000100:00100000:0.0:1788359348.927616:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373312 00000100:00100000:0.0:1788359348.927643:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373824 00000100:00100000:0.0:1788359348.927646:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373824 00000100:00100000:0.0:1788359348.927682:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788359348.934014:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445373312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.934443:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445373312:12345-0@lo:400:kworker.0 Request processed in 453us (8884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359348.934467:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788359348.934481:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445373824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359348.934546:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445373824:12345-0@lo:400:kworker.0 Request processed in 69us (8948us total) trans 0 rc 0/0 00010000:00080000:1.0:1788359348.938290:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fe680 x1875230445372288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359348.938324:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445372288:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788359348.938340:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74ff800 x1875230445373312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359348.938349:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373312:0@lo:400:kworker.0 00010000:00080000:1.0:1788359348.938361:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fea00 x1875230445373824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359348.938369:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373824:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.938383:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445372928:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.938395:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445373440:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.938415:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445372416:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.938582:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372800 00000100:00100000:1.0:1788359348.938590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372800 00000100:00100000:1.0:1788359348.938640:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372544 00000100:00100000:1.0:1788359348.938643:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372544 00000100:00100000:1.0:1788359348.938661:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788359348.939268:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445372800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.939354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445372800:12345-0@lo:400:kworker.0 Request processed in 93us (13916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359348.939361:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788359348.939393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788359348.939410:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445372544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.939455:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445372544:12345-0@lo:400:kworker.0 Request processed in 57us (13809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359348.939461:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788359348.939487:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359348.939491:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788359348.939546:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359348.939551:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788359348.939554:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359348.939614:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445372672 00000100:00100000:1.0:1788359348.939621:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445372672 00000100:00100000:3.0:1788359348.939661:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373952 00000100:00100000:3.0:1788359348.939671:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373952 00000100:00100000:3.0:1788359348.939730:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359348.939740:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445373952:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359348.939746:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788359348.939766:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445372672:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788359348.939778:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359348.939885:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445372672:12345-0@lo:400:kworker.0 Request processed in 123us (13091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359348.939892:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788359348.939924:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445374208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359348.939964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359348.939993:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788359348.940000:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445374080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359348.940077:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788359348.940918:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788359348.940953:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374208 00000100:00100000:2.0:1788359348.940960:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374208 00000100:00100000:2.0:1788359348.941008:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359348.941027:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445374208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359348.941056:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359348.950523:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445373952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10740us (23098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.950556:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788359348.950618:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445372800:0@lo:400:kworker.0 00010000:00080000:0.0:1788359348.950657:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cb3b80 x1875230445373952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359348.950867:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445373952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788359348.951061:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359348.951382:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445372672:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.951402:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445373184:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.951475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.951566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445373696:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.951718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359348.951768:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373184 00000100:00100000:3.0:1788359348.951776:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373184 00000100:00100000:3.0:1788359348.951926:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445373696 00000100:00100000:3.0:1788359348.951930:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445373696 00000100:00100000:3.0:1788359348.951960:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788359348.951971:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445373184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359348.952014:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788359348.952046:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875230445373696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.952108:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445373184:12345-0@lo:400:kworker.0 Request processed in 136us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359348.952133:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788359348.952177:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875230445373696:12345-0@lo:400:kworker.0 Request processed in 138us (453us total) trans 0 rc 0/0 00010000:00080000:3.0:1788359348.952186:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fd880 x1875230445373696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359348.952189:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788359348.952208:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445373696:0@lo:400:kworker.0 00000100:00100000:3.0:1788359348.952229:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445372544:0@lo:400:kworker.0 00010000:00080000:3.0:1788359348.952249:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fd500 x1875230445373056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359348.952259:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445373056:0@lo:400:kworker.0 00010000:00080000:3.0:1788359348.952274:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74ff480 x1875230445373568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359348.952282:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445373568:0@lo:400:kworker.0 00010000:00080000:3.0:1788359348.952314:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fe300 x1875230445373184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359348.952322:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445373184:0@lo:400:kworker.0 00000100:00100000:1.0:1788359348.954577:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359348.955377:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445374208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14355us (15407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359348.955391:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359348.955439:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374080 00000100:00100000:2.0:1788359348.955450:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374080 00010000:00080000:1.0:1788359348.955566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74ff100 x1875230445374208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359348.955591:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445374208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359348.960089:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788359348.960189:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445374080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788359348.960225:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359348.960324:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445374080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (5932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359348.960332:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1788359348.960635:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac6a00 x1875230445374080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359348.960751:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445374080:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788359349.373576:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359349.373589:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaff1c4000 from 7 10000000:01000000:3.0:1788359349.373596:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359349.373668:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.373684:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.373699:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.373746:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.373848:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359349.373924:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788359349.374014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374336 00000100:00100000:0.0:1788359349.374024:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374336 00000100:00100000:0.0:1788359349.374097:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788359349.374111:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445374336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359349.374132:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359349.374151:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae5aa expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359349.374184:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359349.374196:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359349.374208:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14be00, rc 0) 00000100:00100000:0.0:1788359349.374261:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359349.374269:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788359349.374387:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359349.374405:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.374415:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359349.374527:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.374561:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.374584:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac11cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359349.374643:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374464 00000100:00100000:3.0:1788359349.374648:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374464 00000100:00100000:3.0:1788359349.374682:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788359349.374688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.374843:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359349.374851:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788359349.375276:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.375315:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.375370:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.375399:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac11cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359349.375412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374592 00000100:00100000:1.0:1788359349.375417:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374592 00000100:00100000:1.0:1788359349.375444:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788359349.375450:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.375576:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.375584:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788359349.375628:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788359349.377663:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788359349.377887:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788359349.377916:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359349.377934:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.377950:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359349.377966:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359349.377971:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6d76800 from 7 10000000:01000000:3.0:1788359349.377974:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359349.378022:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.378030:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.378043:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.378084:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.378177:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359349.378236:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788359349.378296:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374720 00000100:00100000:1.0:1788359349.378304:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374720 00000100:00100000:1.0:1788359349.378361:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788359349.378373:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445374720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359349.378392:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359349.378409:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae5b8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.378437:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.378449:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.378458:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056600, rc 0) 00000100:00100000:1.0:1788359349.378535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445374720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.378543:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788359349.378646:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359349.378663:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.378673:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.378741:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.378770:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359349.378798:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788359349.378840:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374848 00000100:00100000:1.0:1788359349.378844:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374848 00000100:00100000:1.0:1788359349.378875:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788359349.378881:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445374848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.379009:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445374848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.379017:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788359349.379051:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.379080:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.379134:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.379145:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359349.379188:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445374976 00000100:00100000:3.0:1788359349.379192:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445374976 00000100:00100000:3.0:1788359349.379225:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788359349.379232:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445374976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.379325:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445374976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359349.379333:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788359349.379398:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445374976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788359349.387018:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788359349.387542:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788359349.387583:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788359349.387894:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.387910:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359349.387926:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788359349.387930:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6cef800 from 7 10000000:01000000:1.0:1788359349.387933:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788359349.387999:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.388008:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.388021:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359349.388876:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.388986:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.389039:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac52c2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359349.390628:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375104 00000100:00100000:3.0:1788359349.390647:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375104 00000100:00100000:3.0:1788359349.390723:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788359349.390737:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445375104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359349.390760:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359349.390800:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae5c6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.390851:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.390864:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.390874:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031800, rc 0) 00000100:00100000:3.0:1788359349.390995:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359349.391002:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788359349.392169:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359349.392209:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359349.392224:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359349.392367:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359349.392470:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.392557:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375232 00000100:00100000:2.0:1788359349.392563:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359349.392566:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375232 00000100:00100000:1.0:1788359349.392622:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788359349.392639:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.392819:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.392826:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788359349.394767:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359349.394867:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359349.394987:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359349.395430:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788359349.396546:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375360 00000100:00100000:3.0:1788359349.396564:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375360 00000100:00100000:3.0:1788359349.396647:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788359349.396662:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.396919:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359349.396930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788359349.398670:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788359349.402261:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788359349.402391:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788359349.402435:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359349.402451:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.402466:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359349.402481:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359349.402536:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eae4e42000 from 7 10000000:01000000:3.0:1788359349.402540:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359349.402670:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.402679:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.402694:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.402732:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.402838:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.403343:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375488 00000100:00100000:1.0:1788359349.403353:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375488 00000100:00100000:1.0:1788359349.403416:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788359349.403427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445375488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359349.403445:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359349.403462:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae5d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.403551:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.403566:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.403691:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead28c2a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788359349.403971:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057000, rc 0) 00000100:00100000:1.0:1788359349.404429:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445375488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1001us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.404439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788359349.404682:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359349.404706:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.404719:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359349.404838:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.404880:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359349.405892:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead28c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359349.406710:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375616 00000100:00100000:1.0:1788359349.406724:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375616 00000100:00100000:1.0:1788359349.406936:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788359349.406950:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445375616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.407719:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445375616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 769us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.407750:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788359349.408669:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.408771:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359349.409765:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359349.409947:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375744 00000100:00100000:1.0:1788359349.409959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375744 00000100:00100000:1.0:1788359349.410390:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788359349.410404:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445375744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359349.410622:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445375744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359349.410632:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788359349.412322:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead28c2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788359349.412390:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445375744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788359349.415451:0:13217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788359349.415981:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788359349.416022:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359349.416321:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359349.416338:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359349.635935:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359350.077166:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359350.077454:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126720 00000100:00100000:2.0:1788359350.077466:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126720 00000100:00100000:2.0:1788359350.077581:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 325 00000100:00100000:2.0:1788359350.077592:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:6175:x1875230420126720:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359350.077610:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359350.077630:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6df1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359350.077664:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359350.077676:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359350.077687:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea000, rc 0) 00000100:00100000:2.0:1788359350.077744:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420126720:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 154us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359350.077751:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 325 00000100:00100000:2.0:1788359350.087659:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359350.088107:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126848 00000100:00100000:3.0:1788359350.088119:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126848 00000100:00100000:3.0:1788359350.088225:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 326 00000100:00100000:3.0:1788359350.088235:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420126848:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359350.088397:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420126848:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 163us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359350.088406:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 326 00000100:00100000:0.0:1788359350.093379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359350.100223:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420126976 00000100:00100000:3.0:1788359350.100245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420126976 00000100:00100000:3.0:1788359350.100554:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 327 00000100:00100000:3.0:1788359350.100568:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420126976:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359350.100708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420126976:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 143us (7339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359350.100716:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 327 00000100:00100000:0.0:1788359350.112473:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359350.112660:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127104 00000100:00100000:3.0:1788359350.112673:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127104 00000100:00100000:3.0:1788359350.112738:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 328 00000100:00100000:3.0:1788359350.112760:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420127104:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359350.112782:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359350.113065:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6df8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359350.113102:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359350.113116:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 13 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359350.113128:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41400, rc 0) 00000100:00100000:3.0:1788359350.113192:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420127104:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 435us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359350.113199:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 328 00000100:00100000:2.0:1788359350.118549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.120083:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127232 00000100:00100000:1.0:1788359350.120102:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127232 00000100:00100000:1.0:1788359350.120163:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 329 00000100:00100000:1.0:1788359350.120174:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420127232:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359350.120359:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420127232:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 186us (1819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.120369:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 329 00000100:00100000:1.0:1788359350.136559:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359350.136665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127360 00000100:00100000:0.0:1788359350.136675:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127360 00000100:00100000:0.0:1788359350.136727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 330 00000100:00100000:0.0:1788359350.136737:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420127360:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359350.136893:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420127360:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359350.136902:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 330 00010000:00010000:2.0:1788359350.652765:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359350.717779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.717860:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127488 00000100:00100000:1.0:1788359350.717871:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127488 00000100:00100000:1.0:1788359350.717921:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 331 00000100:00100000:1.0:1788359350.717929:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420127488:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359350.717993:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420127488:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 65us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.718000:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 331 00000100:00100000:1.0:1788359350.729606:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.729639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.729657:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.729679:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359350.729713:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127616 00000100:00100000:1.0:1788359350.729721:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127616 00000100:00100000:1.0:1788359350.729773:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127872 00000100:00100000:1.0:1788359350.729776:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127872 00000100:00100000:1.0:1788359350.729791:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420127744 00000100:00100000:1.0:1788359350.729793:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420127744 00000100:00100000:1.0:1788359350.729803:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128000 00000100:00100000:1.0:1788359350.729805:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128000 00000100:00100000:1.0:1788359350.729820:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 197 00000100:00100000:1.0:1788359350.729828:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420127616:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359350.729898:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420127616:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 70us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.729905:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 197 00000100:00100000:1.0:1788359350.729921:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:1.0:1788359350.729928:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420127872:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359350.729951:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420127872:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.729957:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:1.0:1788359350.729967:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 199 00000100:00100000:1.0:1788359350.729972:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420127744:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359350.729992:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420127744:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.729998:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 199 00000100:00100000:1.0:1788359350.730014:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 200 00000100:00100000:1.0:1788359350.730019:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420128000:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359350.730040:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420128000:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 21us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359350.730046:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 200 00000100:00080000:1.0:1788359350.731000:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359350.731008:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788359351.181031:0:13387:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788359351.485655:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445375872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359351.485761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359351.487452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445375872 00000100:00100000:1.0:1788359351.487482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445375872 00000100:00100000:1.0:1788359351.487604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788359351.487617:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445375872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359351.487667:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359351.487759:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445375872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359351.487767:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788359351.494790:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445375872:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359351.676855:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359352.001489:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359352.001563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445376000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359352.001675:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359352.001893:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376000 00000100:00100000:3.0:1788359352.002169:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376000 00000100:00100000:3.0:1788359352.002238:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788359352.002382:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445376000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359352.002435:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359352.002544:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445376000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359352.002551:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788359352.004711:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445376000:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359352.700805:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359353.735814:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359354.044745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445376128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359354.044830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359354.044956:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376128 00000100:00100000:0.0:1788359354.044964:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376128 00000100:00100000:0.0:1788359354.045030:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788359354.045042:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445376128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788359354.045078:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788359354.045170:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359354.045399:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.045440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.045488:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445376896:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.045549:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.045603:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445377408:0@lo:400:kworker.0 00000100:00100000:2.0:1788359354.045603:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.045656:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.045982:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788359354.045989:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445376512:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046018:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.046036:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445377024:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.046070:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445377536:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.046132:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376384 00000100:00100000:3.0:1788359354.046137:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376384 00000100:00100000:3.0:1788359354.046165:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376896 00000100:00100000:3.0:1788359354.046168:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376896 00000100:00100000:3.0:1788359354.046183:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377408 00000100:00100000:3.0:1788359354.046186:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377408 00000100:00100000:3.0:1788359354.046197:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377024 00000100:00100000:3.0:1788359354.046199:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377024 00000100:00100000:3.0:1788359354.046213:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788359354.046220:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445376384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046260:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445376384:12345-0@lo:400:kworker.0 Request processed in 40us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046268:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788359354.046284:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788359354.046301:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445376896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046329:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445376896:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046335:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788359354.046345:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788359354.046350:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445377408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046372:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445377408:12345-0@lo:400:kworker.0 Request processed in 22us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046378:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788359354.046388:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788359354.046393:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445377024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046417:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445377024:12345-0@lo:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046423:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788359354.046447:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376512 00000100:00100000:3.0:1788359354.046464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376512 00000100:00100000:3.0:1788359354.046520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359354.046528:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445376512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046560:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445376512:12345-0@lo:400:kworker.0 Request processed in 34us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046566:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788359354.046582:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377536 00000100:00100000:3.0:1788359354.046585:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377536 00000100:00100000:3.0:1788359354.046608:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788359354.046615:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445377536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046645:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445377536:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.046658:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788359354.046702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445376512:0@lo:400:kworker.0 00010000:00080000:3.0:1788359354.046716:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6377800 x1875230445377024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.046726:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445377024:0@lo:400:kworker.0 00010000:00080000:3.0:1788359354.046735:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff6300 x1875230445377536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.046743:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445377536:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046753:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445376384:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.046762:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445376896:0@lo:400:kworker.0 00010000:00080000:3.0:1788359354.046771:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff4700 x1875230445377408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.046779:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445377408:0@lo:400:kworker.0 00000100:00080000:1.0:1788359354.047424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359354.047428:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359354.047431:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359354.049078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359354.049208:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445376768:0@lo:400:kworker.0 00000100:00100000:2.0:1788359354.049293:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359354.049327:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445377280:0@lo:400:kworker.0 00000100:00100000:2.0:1788359354.049360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359354.049397:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445377792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359354.049426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.050664:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359354.050686:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445377920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359354.050751:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359354.050871:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445376128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5830us (6038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.050882:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788359354.050907:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377792 00000100:00100000:0.0:1788359354.050913:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377792 00000100:00100000:0.0:1788359354.050937:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377920 00000100:00100000:0.0:1788359354.050939:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377920 00000100:00100000:0.0:1788359354.050979:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359354.050997:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445377792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359354.051026:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359354.051062:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445377792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.051067:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359354.051079:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359354.051096:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445377920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788359354.051109:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359354.051135:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445377920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.051141:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359354.051165:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377280 00000100:00100000:0.0:1788359354.051169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377280 00000100:00100000:0.0:1788359354.051194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788359354.051200:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445377280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359354.051229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445377280:12345-0@lo:400:kworker.0 Request processed in 30us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.051234:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788359354.051385:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445378048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359354.051412:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788359354.051462:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7595c00 x1875230445377920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.051490:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445377920:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788359354.051563:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359354.051568:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359354.052620:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378048 00000100:00100000:0.0:1788359354.052629:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378048 00000100:00100000:0.0:1788359354.052676:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788359354.052683:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445378048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359354.052701:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359354.052749:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445378048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.052755:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788359354.052924:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac4a80 x1875230445378048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.052940:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445378048:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788359354.052960:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359354.053371:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376256 00000100:00100000:0.0:1788359354.053376:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376256 00000100:00100000:0.0:1788359354.053413:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788359354.053420:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445376256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359354.053473:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445376256:12345-0@lo:400:kworker.0 Request processed in 53us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359354.053480:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788359354.054749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376768 00000100:00100000:3.0:1788359354.054761:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376768 00000100:00100000:3.0:1788359354.054802:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788359354.054809:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445376768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.054870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445376768:12345-0@lo:400:kworker.0 Request processed in 61us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.054876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788359354.056280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788359354.058587:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445376640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.058679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.058733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445376640 00000100:00100000:3.0:1788359354.058741:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445376640 00000100:00100000:3.0:1788359354.058791:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788359354.058799:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445376640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.058851:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445376640:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.058858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788359354.058903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445376640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.058912:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445377152:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.058938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.058982:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445377664:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.059003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359354.059023:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377152 00000100:00100000:3.0:1788359354.059027:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377152 00000100:00100000:3.0:1788359354.059049:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445377664 00000100:00100000:3.0:1788359354.059052:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445377664 00000100:00100000:3.0:1788359354.059067:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788359354.059072:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445377152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.059103:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445377152:12345-0@lo:400:kworker.0 Request processed in 30us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.059109:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788359354.059119:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788359354.059124:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445377664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.059145:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445377664:12345-0@lo:400:kworker.0 Request processed in 21us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359354.059150:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1788359354.059180:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff4a80 x1875230445377664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.059190:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445377664:0@lo:400:kworker.0 00010000:00080000:3.0:1788359354.059206:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fd500 x1875230445377792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.059219:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445377792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359354.059232:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445376256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.059243:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445376768:0@lo:400:kworker.0 00000100:00100000:3.0:1788359354.059254:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445377280:0@lo:400:kworker.0 00010000:00080000:3.0:1788359354.059294:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6374000 x1875230445377152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359354.059303:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445377152:0@lo:400:kworker.0 00010000:00080000:0.0:1788359354.065034:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac5880 x1875230445376128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359354.065062:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445376128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788359354.749011:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359355.773333:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359355.837448:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359355.837521:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359355.837549:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359355.837592:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359355.837616:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359355.837655:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128128 00000100:00100000:1.0:1788359355.837665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128128 00000100:00100000:1.0:1788359355.837716:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 333 00000100:00100000:1.0:1788359355.837726:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420128128:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359355.837796:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420128128:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359355.837803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 333 00000100:00100000:3.0:1788359355.837977:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128256 00000100:00100000:3.0:1788359355.837982:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128256 00000100:00100000:3.0:1788359355.838078:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128512 00000100:00100000:3.0:1788359355.838082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128512 00000100:00100000:3.0:1788359355.838095:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128384 00000100:00100000:3.0:1788359355.838097:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128384 00000100:00100000:3.0:1788359355.838109:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128640 00000100:00100000:3.0:1788359355.838111:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128640 00000100:00100000:3.0:1788359355.838123:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 207 00000100:00100000:3.0:1788359355.838131:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420128256:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359355.838172:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420128256:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 42us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359355.838179:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 207 00000100:00100000:3.0:1788359355.838192:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 208 00000100:00100000:3.0:1788359355.838198:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420128512:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359355.838220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420128512:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359355.838226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 208 00000100:00100000:3.0:1788359355.838237:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 209 00000100:00100000:3.0:1788359355.838243:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420128384:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359355.838263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420128384:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 21us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359355.838280:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 209 00000100:00100000:3.0:1788359355.838291:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 210 00000100:00100000:3.0:1788359355.838297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420128640:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359355.838322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420128640:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 25us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359355.838327:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 210 00000100:00080000:1.0:1788359355.838727:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359355.838733:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359356.609148:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788359356.609174:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445378176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788359356.609246:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359356.609324:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378176 00000100:00100000:1.0:1788359356.609333:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378176 00000100:00100000:1.0:1788359356.609461:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788359356.609473:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445378176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359356.609533:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359356.609595:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445378176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359356.609604:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788359356.609667:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445378176:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359356.797162:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359357.116781:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359357.116804:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445378304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359357.116873:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359357.120546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378304 00000100:00100000:0.0:1788359357.120564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378304 00000100:00100000:0.0:1788359357.120657:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788359357.120670:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445378304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359357.120715:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359357.120822:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445378304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359357.120830:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788359357.122073:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445378304:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359357.822251:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788359358.380859:0:13536:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:29:16 (1788359356) === 00000100:00100000:1.0:1788359358.664253:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.664555:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128768 00000100:00100000:3.0:1788359358.664564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128768 00000100:00100000:3.0:1788359358.664631:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:3.0:1788359358.664642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420128768:12345-192.168.202.52@tcp:41:mkdir.0 00000100:00100000:1.0:1788359358.664839:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00080000:0.0:1788359358.664863:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359358.664878:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420128896 00000100:00100000:1.0:1788359358.664882:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420128896 00000100:00100000:1.0:1788359358.664921:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:1.0:1788359358.664928:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10515:x1875230420128896:12345-192.168.202.52@tcp:700:mkdir.0 00000100:00100000:1.0:1788359358.664999:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10515:x1875230420128896:12345-192.168.202.52@tcp:700:mkdir.0 Request processed in 70us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359358.665006:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00000004:00000024:3.0:1788359358.667222:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788359358.667443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420128768:12345-192.168.202.52@tcp:41:mkdir.0 Request processed in 2799us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.667453:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:1.0:1788359358.669572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.669646:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129152 00000100:00100000:3.0:1788359358.669655:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129152 00000100:00100000:3.0:1788359358.669723:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:3.0:1788359358.669741:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:10515:x1875230420129152:12345-192.168.202.52@tcp:36:mkdir.0 00010000:00010000:3.0:1788359358.669798:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359358.669825:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae492 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d6c expref: 6 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.669867:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eb020dd000) 00010000:00010000:3.0:1788359358.669915:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359358.670015:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.670028:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.670038:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.670050:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.670058:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.670064:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672103:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672124:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672135:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359358.672153:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f1e5462 reply state 00000000ee79458e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672181:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672188:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359358.672192:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359358.672196:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788359358.672201:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788359358.672210:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672216:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672222:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672228:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217f400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.672232:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672240:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672249:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359358.672251:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.672255:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672261:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae5f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359358.672289:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f1e5462 reply state 00000000ee79458e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672298:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.672304:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.672307:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359358.672309:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788359358.673062:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10515:x1875230420129152:12345-192.168.202.52@tcp:36:mkdir.0 Request processed in 3316us (3491us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788359358.673072:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:1.0:1788359358.710166:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.710308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129280 00000100:00100000:3.0:1788359358.710318:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129280 00000100:00100000:3.0:1788359358.710378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:3.0:1788359358.710388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10517:x1875230420129280:12345-192.168.202.52@tcp:101:chmod.0 00010000:00010000:3.0:1788359358.710417:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.710440:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6dff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710533:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710547:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710558:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.710618:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359358.710622:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359358.710658:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710685:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dff expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710703:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dff expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.710712:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359358.710715:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359358.710718:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217fe00, rc 0) 00000100:00100000:3.0:1788359358.710793:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:10517:x1875230420129280:12345-192.168.202.52@tcp:101:chmod.0 Request processed in 406us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.710801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:0.0:1788359358.725576:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.725653:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129536 00000100:00100000:3.0:1788359358.725663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129536 00000100:00100000:3.0:1788359358.725719:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:3.0:1788359358.725740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:10517:x1875230420129536:12345-192.168.202.52@tcp:36:chmod.0 00010000:00010000:3.0:1788359358.725793:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359358.725819:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae60c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6dff expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.725840:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359358.725865:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359358.725889:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.725902:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.725924:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359358.726135:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb1e5ca3 reply state 000000009ca0079e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.726149:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.726155:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.726158:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788359358.726161:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788359358.726168:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788359358.726249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:10517:x1875230420129536:12345-192.168.202.52@tcp:36:chmod.0 Request processed in 521us (682us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788359358.726256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:2.0:1788359358.764029:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.764161:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129664 00000100:00100000:3.0:1788359358.764171:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129664 00000100:00100000:3.0:1788359358.764241:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 26 00000100:00100000:3.0:1788359358.764252:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+9:10519:x1875230420129664:12345-192.168.202.52@tcp:101:chown.0 00010000:00010000:3.0:1788359358.764276:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.764309:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae61a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e06 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764400:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764432:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764445:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.764530:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359358.764535:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359358.764569:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764594:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae61a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e06 expref: 11 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764612:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e06 expref: 10 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.764620:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.764623:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359358.764626:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217e200, rc 0) 00000100:00100000:3.0:1788359358.764675:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+10:10519:x1875230420129664:12345-192.168.202.52@tcp:101:chown.0 Request processed in 426us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.764682:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 26 00000100:00100000:2.0:1788359358.776422:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.776563:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129792 00000100:00100000:3.0:1788359358.776587:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129792 00000100:00100000:3.0:1788359358.776693:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:3.0:1788359358.776704:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:10519:x1875230420129792:12345-192.168.202.52@tcp:101:chown.0 00010000:00010000:3.0:1788359358.776733:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.776761:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae628 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e0d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776853:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776870:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776883:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776896:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776917:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.776925:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777031:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777040:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777048:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.777112:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359358.777116:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359358.777140:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777156:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777162:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777169:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777176:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217ea00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.777180:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777189:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777203:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.777206:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.777212:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777218:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae62f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777234:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777250:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777256:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777261:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.777264:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777271:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777279:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.777282:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.777285:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777291:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae636 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777324:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae628 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e0d expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777340:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e0d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.777348:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359358.777350:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359358.777359:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41200, rc 0) 00000100:00100000:3.0:1788359358.777454:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10519:x1875230420129792:12345-192.168.202.52@tcp:101:chown.0 Request processed in 752us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.777462:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:0.0:1788359358.782637:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359358.782749:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420129920 00000100:00100000:2.0:1788359358.782759:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420129920 00000100:00100000:2.0:1788359358.782818:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359358.782829:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10519:x1875230420129920:12345-192.168.202.52@tcp:900:chown.0 00000100:00100000:2.0:1788359358.782921:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10519:x1875230420129920:12345-192.168.202.52@tcp:900:chown.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359358.782930:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359358.803020:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359358.803147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420130176 00000100:00100000:0.0:1788359358.803164:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420130176 00000100:00100000:0.0:1788359358.803393:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:0.0:1788359358.803477:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10519:x1875230420130176:12345-192.168.202.52@tcp:36:chown.0 00010000:00010000:0.0:1788359358.803577:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359358.803623:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae63d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e0d expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.803650:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:0.0:1788359358.803655:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359358.803681:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.803695:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.803705:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788359358.810925:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1788359358.811062:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811080:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811089:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811095:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217e000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.811100:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811108:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811126:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.811129:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.811135:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811141:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae5f7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811166:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811172:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811256:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811264:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217f600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.811268:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.811275:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359358.811390:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000200d7def reply state 00000000a926c570 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.811419:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.811427:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:0.0:1788359358.811430:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788359358.811434:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788359358.811447:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788359358.811589:0:6516:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788359358.811614:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:10519:x1875230420130176:12345-192.168.202.52@tcp:36:chown.0 Request processed in 8208us (8605us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788359358.811623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00010000:00010000:2.0:1788359358.811841:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811856:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811862:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811867:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359358.811870:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811877:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811887:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:2.0:1788359358.811889:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788359358.811893:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359358.811899:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae644 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812261:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359358.812264:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.812268:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812275:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae5fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812366:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812374:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812380:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812384:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217f400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.812387:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812412:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812482:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.812485:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788359358.812488:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.812586:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae613 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359358.834027:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359358.834125:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420130304 00000100:00100000:2.0:1788359358.834138:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420130304 00000100:00100000:2.0:1788359358.834203:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:2.0:1788359358.834212:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+6:10520:x1875230420130304:12345-192.168.202.52@tcp:101:touch.500 00010000:00010000:2.0:1788359358.834238:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359358.834258:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae64b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e14 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359358.835597:0:10096:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1279us 00010000:00010000:0.0:1788359358.845014:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359358.855858:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.855883:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.855897:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.855916:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.855923:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.855930:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856050:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856063:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856070:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.856101:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359358.856105:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359358.856140:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856151:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856158:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856165:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856171:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.856175:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856183:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856194:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.856197:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.856202:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856218:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856233:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856239:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856244:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856250:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.856253:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856258:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856266:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359358.856268:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.856271:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856277:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856314:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae64b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e14 expref: 8 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856329:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e14 expref: 7 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.856342:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.856345:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788359358.856347:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217f400, rc 0) 00000100:00100000:3.0:1788359358.856462:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10520:x1875230420130304:12345-192.168.202.52@tcp:101:touch.500 Request processed in 22248us (22442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.856472:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:1.0:1788359358.864373:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.864453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420130560 00000100:00100000:3.0:1788359358.864470:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420130560 00000100:00100000:3.0:1788359358.864705:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:3.0:1788359358.864719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10520:x1875230420130560:12345-192.168.202.52@tcp:101:touch.500 00010000:00010000:3.0:1788359358.864747:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.864773:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae667 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e1b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.864914:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.864933:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.864959:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.865251:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.865273:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.865394:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359358.870002:0:6515:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788359358.870227:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae67c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870245:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870258:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae67c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870296:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870304:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870311:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870317:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217e000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359358.870321:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870328:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870340:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.870342:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359358.870360:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870367:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae66e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359358.870382:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000014df000 reply state 000000003b61247b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870393:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870401:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359358.870415:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359358.870418:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788359358.870471:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae667 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e1b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870575:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae67c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e1b expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.870583:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359358.870586:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359358.870588:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217ea00, rc 0) 00000100:00100000:3.0:1788359358.870664:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:10520:x1875230420130560:12345-192.168.202.52@tcp:101:touch.500 Request processed in 5948us (6303us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788359358.870673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:2.0:1788359358.880077:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359358.880183:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420130816 00000100:00100000:0.0:1788359358.880201:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420130816 00000100:00100000:0.0:1788359358.880302:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:0.0:1788359358.880314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+10:10520:x1875230420130816:12345-192.168.202.52@tcp:36:touch.500 00010000:00010000:0.0:1788359358.880410:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359358.880450:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae67c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e1b expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.880478:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:0.0:1788359358.880548:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359358.880812:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.880830:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.880842:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359358.881000:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000000d338e8 reply state 00000000e6b4c074 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.881015:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359358.881022:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:0.0:1788359358.881025:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359358.881028:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788359358.881153:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10520:x1875230420130816:12345-192.168.202.52@tcp:36:touch.500 Request processed in 839us (1081us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788359358.881162:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:1.0:1788359358.889702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.889785:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420130944 00000100:00100000:3.0:1788359358.889803:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420130944 00000100:00100000:3.0:1788359358.890208:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:3.0:1788359358.890221:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+11:10520:x1875230420130944:12345-192.168.202.52@tcp:101:touch.500 00010000:00010000:3.0:1788359358.890270:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.890299:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae691 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e22 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.890377:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e22 expref: 12 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.890395:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae691 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e22 expref: 12 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.890428:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:3.0:1788359358.890432:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359358.890436:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217f600, rc 0) 00000100:00100000:3.0:1788359358.890889:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+12:10520:x1875230420130944:12345-192.168.202.52@tcp:101:touch.500 Request processed in 668us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.890899:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:1.0:1788359358.894979:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.895090:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131072 00000100:00100000:3.0:1788359358.895100:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131072 00000100:00100000:3.0:1788359358.895150:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:3.0:1788359358.895159:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420131072:12345-192.168.202.52@tcp:8:touch.500 00010000:00080000:3.0:1788359358.895220:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:3.0:1788359358.895252:0:8430:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae698 00002000:00100000:3.0:1788359358.895264:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10b7ecde-1562-4877-be1f-e5861af40d5e/ffffa0eaffadf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788359358.895282:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788359358.895356:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788359358.895395:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0eaffada800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359358.895485:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420131072:12345-192.168.202.52@tcp:8:touch.500 Request processed in 325us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.895536:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:2.0:1788359358.898072:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.898148:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131200 00000100:00100000:3.0:1788359358.898157:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131200 00000100:00100000:3.0:1788359358.898213:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:3.0:1788359358.898228:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:0:x1875230420131200:12345-192.168.202.52@tcp:2:touch.500 00000100:00080000:0.0:1788359358.898248:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788359358.909212:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788359358.909227:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000100:00100000:3.0:1788359358.909470:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:0:x1875230420131200:12345-192.168.202.52@tcp:2:touch.500 Request processed in 11241us (11397us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788359358.909482:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:1.0:1788359358.916452:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.917111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131456 00000100:00100000:3.0:1788359358.917122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131456 00000100:00100000:3.0:1788359358.917259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:3.0:1788359358.917270:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+12:10520:x1875230420131456:12345-192.168.202.52@tcp:35:touch.500 00000100:00100000:3.0:1788359358.917592:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:10520:x1875230420131456:12345-192.168.202.52@tcp:35:touch.500 Request processed in 323us (1148us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788359358.917601:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:1.0:1788359358.938972:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.939169:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131584 00000100:00100000:3.0:1788359358.939179:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131584 00000100:00100000:3.0:1788359358.939281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:3.0:1788359358.939292:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:10522:x1875230420131584:12345-192.168.202.52@tcp:101:rm.0 00010000:00010000:3.0:1788359358.939315:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.939335:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae69f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e29 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939417:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939443:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939454:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.939527:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359358.939531:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359358.939565:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939591:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae69f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e29 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939608:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e29 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.939615:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.939618:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359358.939621:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb0217ea00, rc 0) 00000100:00100000:3.0:1788359358.939670:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+14:10522:x1875230420131584:12345-192.168.202.52@tcp:101:rm.0 Request processed in 380us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.939689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:0.0:1788359358.946148:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.946256:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131840 00000100:00100000:3.0:1788359358.946268:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131840 00000100:00100000:3.0:1788359358.946359:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:3.0:1788359358.946381:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+14:10522:x1875230420131840:12345-192.168.202.52@tcp:101:rm.0 00010000:00010000:3.0:1788359358.946412:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.946448:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e30 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.946639:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788359358.947166:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e30 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.947183:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359358.947186:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359358.947192:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e30 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.947209:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41200, rc 0) 00000100:00100000:3.0:1788359358.947317:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+15:10522:x1875230420131840:12345-192.168.202.52@tcp:101:rm.0 Request processed in 949us (1178us total) trans 4294967305 rc 301/301 00000100:00100000:3.0:1788359358.947325:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:1.0:1788359358.958241:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359358.958337:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420131968 00000100:00100000:2.0:1788359358.958346:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420131968 00000100:00100000:2.0:1788359358.959310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:2.0:1788359358.959322:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:10522:x1875230420131968:12345-192.168.202.52@tcp:37:rm.0 00000100:00100000:2.0:1788359358.967399:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:10522:x1875230420131968:12345-192.168.202.52@tcp:37:rm.0 Request processed in 8069us (9157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359358.967423:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:0.0:1788359358.977031:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.977171:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420132224 00000100:00100000:3.0:1788359358.977181:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420132224 00000100:00100000:3.0:1788359358.977239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:3.0:1788359358.977249:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d94850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+15:10522:x1875230420132224:12345-192.168.202.52@tcp:35:rm.0 00000100:00100000:3.0:1788359358.977484:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d94850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+16:10522:x1875230420132224:12345-192.168.202.52@tcp:35:rm.0 Request processed in 236us (463us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788359358.977492:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:1.0:1788359358.984069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.984163:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420132480 00000100:00100000:3.0:1788359358.984174:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420132480 00000100:00100000:3.0:1788359358.984233:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:3.0:1788359358.984243:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+16:10522:x1875230420132480:12345-192.168.202.52@tcp:101:rm.0 00010000:00010000:3.0:1788359358.984284:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359358.984304:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e37 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.984425:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae6c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.984440:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.984452:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359358.984464:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788359358.984599:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e37 expref: 19 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.984622:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e37 expref: 18 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359358.984631:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359358.984634:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788359358.984637:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eafac41800, rc 0) 00000100:00100000:3.0:1788359358.985182:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420132480:12345-192.168.202.52@tcp:101:rm.0 Request processed in 938us (1120us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788359358.985190:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:1.0:1788359358.995542:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359358.995664:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420132608 00000100:00100000:3.0:1788359358.995674:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420132608 00000100:00100000:3.0:1788359358.995746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:3.0:1788359358.995769:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420132608:12345-192.168.202.52@tcp:41:rm.0 00000004:00000024:3.0:1788359358.995941:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788359358.996170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420132608:12345-192.168.202.52@tcp:41:rm.0 Request processed in 401us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359358.996179:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:2.0:1788359359.000591:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359359.000889:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420132736 00000100:00100000:3.0:1788359359.000900:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420132736 00000100:00100000:3.0:1788359359.001089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:3.0:1788359359.001099:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420132736:12345-192.168.202.52@tcp:101:rm.0 00010000:00010000:3.0:1788359359.001121:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359359.001143:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e3e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001211:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001226:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001237:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001269:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001277:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001285:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001449:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001458:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.001465:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359359.003053:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788359359.003063:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359359.003091:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003109:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003120:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003127:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003133:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003140:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217e000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359359.003144:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003152:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003183:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359359.003186:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359359.003191:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003198:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e000/0x49dd053b5feae6d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003216:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003222:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003227:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003233:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359359.003235:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003242:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003249:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359359.003251:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359359.003254:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003259:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae6de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003301:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41200/0x49dd053b5feae6d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e3e expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003317:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e3e expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.003325:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:3.0:1788359359.003327:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359359.003330:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6200, rc 0) 00000100:00100000:2.0:1788359359.004238:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+19:10522:x1875230420132736:12345-192.168.202.52@tcp:101:rm.0 Request processed in 3129us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359359.004254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:1.0:1788359359.010274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359359.010698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420132992 00000100:00100000:0.0:1788359359.010709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420132992 00000100:00100000:0.0:1788359359.010786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:0.0:1788359359.010887:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+19:10522:x1875230420132992:12345-192.168.202.52@tcp:36:rm.0 00010000:00010000:0.0:1788359359.010962:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788359359.010989:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feae6e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e3e expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011012:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f600/0x49dd053b5feae691 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e22 expref: 18 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011024:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:0.0:1788359359.011033:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217ea00/0x49dd053b5feae6a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e29 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011043:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:0.0:1788359359.011046:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359359.011068:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011080:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011089:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011120:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011129:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011136:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011252:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011261:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.011269:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359359.011869:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788359359.011881:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390982385580ns, next at 391982383606ns, rc = 0 00010000:00010000:0.0:1788359359.012094:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012105:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012113:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012121:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012141:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012147:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012171:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359359.012194:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012200:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012206:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012213:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359359.012217:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012225:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012235:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:0.0:1788359359.012238:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788359359.012242:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012248:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae6fa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012264:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012276:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012282:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012287:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359359.012291:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012297:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012306:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:0.0:1788359359.012308:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359359.012311:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012316:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae6ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359359.012326:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059796bb6 reply state 000000003e1be711 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012337:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359359.012343:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffffa0eacc5ac800) 00010000:00010000:0.0:1788359359.012345:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359359.012348:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788359359.013090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420132992:12345-192.168.202.52@tcp:36:rm.0 Request processed in 2200us (2820us total) trans 4294967308 rc 0/0 00010000:00010000:1.0:1788359359.015976:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359359.015990:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359359.016001:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359359.016005:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359359.016034:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359359.016054:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:1.0:1788359359.016057:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788359359.016062:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359359.016068:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b800/0x49dd053b5feae701 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359359.016086:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359359.016088:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359359.016090:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359359.018411:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:1.0:1788359359.018640:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359359.018752:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420133248 00000100:00100000:0.0:1788359359.018762:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420133248 00000100:00100000:0.0:1788359359.020109:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:0.0:1788359359.020128:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420133248:12345-192.168.202.52@tcp:35:rm.0 00000100:00100000:0.0:1788359359.020359:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+19:10522:x1875230420133248:12345-192.168.202.52@tcp:35:rm.0 Request processed in 237us (1720us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788359359.021557:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:2.0:1788359359.026434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359359.026667:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420133504 00000100:00100000:3.0:1788359359.026689:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420133504 00000100:00100000:3.0:1788359359.026769:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:3.0:1788359359.026780:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+19:10522:x1875230420133504:12345-192.168.202.52@tcp:36:rm.0 00010000:00010000:3.0:1788359359.026853:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788359359.026880:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eafac41800/0x49dd053b5feae6c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e37 expref: 19 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.026918:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217f400/0x49dd053b5feae660 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e14 expref: 18 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.026933:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359359.026958:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217e200/0x49dd053b5feae621 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e06 expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.026969:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359359.026975:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359359.027013:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027027:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027038:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027050:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027057:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027063:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027140:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027149:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027156:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359359.027386:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788359359.027411:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027419:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027436:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027442:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359359.027447:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027454:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027464:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359359.027467:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788359359.027471:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027477:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7e00/0x49dd053b5feae716 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027530:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027538:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027543:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027549:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359359.027552:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027568:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027576:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5aca00) 00010000:00010000:3.0:1788359359.027578:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359359.027582:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027588:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feae708 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359359.027600:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1cccf73 reply state 00000000f16df2a0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027611:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359359.027617:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5ac600) 00010000:00010000:3.0:1788359359.027620:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359359.027622:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359359.027692:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:10522:x1875230420133504:12345-192.168.202.52@tcp:36:rm.0 Request processed in 912us (1268us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788359359.027699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:3.0:1788359359.165032:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445378432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359359.165114:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.165166:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445378944:0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.165191:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.165208:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445379456:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.165235:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445378688:0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.165238:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.165261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.165262:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445379968:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.165277:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445379200:0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.165280:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.165294:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.165297:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788359359.165302:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445378560:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.165308:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445379712:0@lo:400:kworker.0 00000100:00100000:0.0:1788359359.165435:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378432 00000100:00100000:0.0:1788359359.165441:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378432 00000100:00100000:0.0:1788359359.165490:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359359.165514:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445378432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788359359.165543:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359359.166758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378944 00000100:00100000:1.0:1788359359.166766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378944 00000100:00100000:1.0:1788359359.166818:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378688 00000100:00100000:1.0:1788359359.166822:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378688 00000100:00100000:1.0:1788359359.166840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379200 00000100:00100000:1.0:1788359359.166843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379200 00000100:00100000:1.0:1788359359.166861:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788359359.166868:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445378944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.169121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169177:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445379072:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.169183:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359359.169244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169268:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445379584:0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.169293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169312:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445380096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.169332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169355:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445380480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359359.169455:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359359.169601:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379456 00000100:00100000:3.0:1788359359.169608:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379456 00000100:00100000:3.0:1788359359.169645:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379968 00000100:00100000:3.0:1788359359.169648:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379968 00000100:00100000:3.0:1788359359.169662:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379584 00000100:00100000:3.0:1788359359.169664:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379584 00000100:00100000:3.0:1788359359.169749:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380096 00000100:00100000:3.0:1788359359.169753:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380096 00000100:00100000:3.0:1788359359.169769:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788359359.169777:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445379456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170205:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445379456:12345-0@lo:400:kworker.0 Request processed in 426us (4963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170213:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788359359.170246:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788359359.170252:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445379968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170281:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445379968:12345-0@lo:400:kworker.0 Request processed in 30us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170289:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788359359.170300:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359359.170305:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445379584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170331:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445379584:12345-0@lo:400:kworker.0 Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170336:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788359359.170344:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788359359.170349:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445380096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170446:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445380096:12345-0@lo:400:kworker.0 Request processed in 96us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170451:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788359359.170478:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378560 00000100:00100000:3.0:1788359359.170482:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378560 00000100:00100000:3.0:1788359359.170552:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788359359.170559:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445378560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170588:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3642:x1875230445378560:12345-0@lo:400:kworker.0 Request processed in 30us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170594:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788359359.170624:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379072 00000100:00100000:3.0:1788359359.170627:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379072 00000100:00100000:3.0:1788359359.170649:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788359359.170655:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445379072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.170764:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445379072:12345-0@lo:400:kworker.0 Request processed in 109us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359359.170770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788359359.171067:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380480 00000100:00100000:0.0:1788359359.171072:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380480 00000100:00100000:0.0:1788359359.171096:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788359359.171102:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445380480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788359359.171117:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359359.171152:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445380480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359359.171157:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788359359.171174:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788359359.171178:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359359.171181:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359359.171202:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445378432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5691us (6088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359359.171219:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788359359.171292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.171326:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788359359.171336:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445378816:0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.171828:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445378944:12345-0@lo:400:kworker.0 Request processed in 4958us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359359.171838:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788359359.171857:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379712 00000100:00100000:1.0:1788359359.171862:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379712 00000100:00100000:2.0:1788359359.171865:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.171889:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445379328:0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.171894:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788359359.171901:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445378688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.171921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.171933:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445379840:0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.171934:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445378688:12345-0@lo:400:kworker.0 Request processed in 35us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359359.171940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788359359.171950:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379328 00000100:00100000:1.0:1788359359.171953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379328 00000100:00100000:1.0:1788359359.171968:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788359359.171974:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445379200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.172003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445379200:12345-0@lo:400:kworker.0 Request processed in 29us (6707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359359.172008:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788359359.172019:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788359359.172025:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445379712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.172045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359359.172122:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445378816 00000100:00100000:0.0:1788359359.172126:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445378816 00000100:00100000:0.0:1788359359.172151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788359359.172158:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.172172:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445379712:12345-0@lo:400:kworker.0 Request processed in 147us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359359.172183:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788359359.172194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445379840 00000100:00100000:1.0:1788359359.172197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445379840 00000100:00100000:1.0:1788359359.172211:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788359359.172216:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445379328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359359.172259:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380224 00000100:00100000:3.0:1788359359.172264:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380224 00000100:00100000:3.0:1788359359.172288:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788359359.172294:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359359.172306:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359359.176066:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359359.176131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359359.176168:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445378688:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.176181:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445379200:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.176192:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445379712:0@lo:400:kworker.0 00000100:00100000:2.0:1788359359.176245:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380352 00000100:00100000:2.0:1788359359.176251:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380352 00000100:00100000:2.0:1788359359.176292:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359359.176300:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359359.176325:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359359.177695:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445378816:12345-0@lo:400:kworker.0 Request processed in 5530us (5821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359359.177709:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788359359.178026:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1723us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359359.178034:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359359.178114:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445378816:0@lo:400:kworker.0 00010000:00080000:2.0:1788359359.178131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad2680 x1875230445380352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359359.178153:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359359.178187:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788359359.178199:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445379840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.178216:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445379328:12345-0@lo:400:kworker.0 Request processed in 5998us (6293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359359.178224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788359359.178242:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445379840:12345-0@lo:400:kworker.0 Request processed in 47us (6196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359359.178260:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00080000:2.0:1788359359.178284:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb62a00 x1875230445379328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359359.178293:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445379328:0@lo:400:kworker.0 00010000:00080000:2.0:1788359359.178303:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb63b80 x1875230445379840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359359.178311:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445379840:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178361:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffad1500 x1875230445380480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178375:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445380480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359359.178409:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445378560:0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.178423:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445379072:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178433:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb63480 x1875230445379584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178440:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445379584:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178451:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb60e00 x1875230445380096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178459:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445380096:0@lo:400:kworker.0 00000100:00100000:1.0:1788359359.178471:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445378944:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178482:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb61880 x1875230445379456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178489:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445379456:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178522:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb63800 x1875230445379968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178529:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445379968:0@lo:400:kworker.0 00010000:00080000:1.0:1788359359.178539:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eafeff4a80 x1875230445378432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178551:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eafeff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445378432:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788359359.178596:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359359.178602:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359359.178780:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6484us (7486us total) trans 0 rc 0/0 00010000:00080000:1.0:1788359359.178939:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac6680 x1875230445380224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359359.178959:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359359.178995:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00010000:1.0:1788359359.868626:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359360.897645:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359360.964092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359360.964209:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359360.964210:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420133760 00000100:00100000:0.0:1788359360.964219:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420133760 00000100:00100000:1.0:1788359360.964236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359360.964260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359360.964276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359360.964276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134272 00000100:00100000:0.0:1788359360.964279:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134272 00000100:00100000:0.0:1788359360.964296:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420133888 00000100:00100000:1.0:1788359360.964298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359360.964298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420133888 00000100:00100000:0.0:1788359360.964310:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134144 00000100:00100000:0.0:1788359360.964313:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134144 00000100:00100000:1.0:1788359360.964316:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 217 00000100:00100000:0.0:1788359360.964325:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 218 00000100:00100000:1.0:1788359360.964327:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2405:x1875230420133760:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359360.964331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420134272:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359360.964591:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134016 00000100:00100000:3.0:1788359360.964599:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134016 00000100:00100000:3.0:1788359360.964628:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:3.0:1788359360.964634:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420134016:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359360.967301:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2405:x1875230420133760:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 2965us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359360.967315:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 217 00000100:00100000:1.0:1788359360.967355:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 219 00000100:00100000:1.0:1788359360.967370:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420133888:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359360.967428:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420133888:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 65us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359360.967434:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 219 00000100:00100000:1.0:1788359360.967448:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 220 00000100:00100000:1.0:1788359360.967457:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420134144:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359360.967481:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420134144:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 26us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359360.967488:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 220 00000100:00100000:1.0:1788359360.967537:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420133632 00000100:00100000:1.0:1788359360.967545:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420133632 00000100:00100000:1.0:1788359360.967620:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 335 00000100:00100000:1.0:1788359360.967628:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420133632:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359360.967653:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420133632:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (3392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359360.967659:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 335 00000100:00080000:1.0:1788359360.967995:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359360.968001:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359360.968004:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359360.968256:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420134016:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 3619us (4045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359360.968265:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:0.0:1788359360.968537:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420134272:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 4203us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359360.968546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 218 00000100:00100000:1.0:1788359361.724635:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445380608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788359361.724706:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359361.728174:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380608 00000100:00100000:2.0:1788359361.728191:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380608 00000100:00100000:2.0:1788359361.728248:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788359361.728259:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445380608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359361.728307:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359361.728397:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445380608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359361.728404:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788359361.728455:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445380608:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359361.916699:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359362.237266:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359362.237341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359362.237552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380736 00000100:00100000:2.0:1788359362.237560:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380736 00000100:00100000:2.0:1788359362.237623:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788359362.237634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788359362.237671:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788359362.251920:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445380736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14279us (14569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359362.251936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788359362.253425:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445380736:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359362.941995:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788359363.404221:0:13684:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788359363.965016:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788359364.284598:0:8880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396255099821ns, next at 397255097573ns, rc = 0 00000100:00100000:3.0:1788359364.284606:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445380992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359364.284674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.284724:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445380864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359364.284745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359364.285512:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359364.285524:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445381120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359364.285576:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359364.285616:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380992 00000100:00100000:0.0:1788359364.285625:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380992 00000100:00080000:1.0:1788359364.285683:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359364.285703:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445380864 00000100:00100000:0.0:1788359364.285710:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445380864 00000100:00100000:1.0:1788359364.285810:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381120 00000100:00100000:1.0:1788359364.285815:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381120 00000100:00100000:1.0:1788359364.285835:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359364.285844:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445380992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359364.285881:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359364.285940:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445380992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.285957:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788359364.285974:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359364.285980:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445380864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359364.285995:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359364.286021:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445380864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.286028:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359364.286040:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788359364.286046:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445381120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359364.286055:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359364.286080:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445381120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.286091:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788359364.286235:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359364.286272:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445381248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359364.286305:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359364.286308:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788359364.286336:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac6d80 x1875230445381120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359364.286365:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445381120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359364.286442:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381248 00010000:00080000:3.0:1788359364.286445:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaece0ca80 x1875230445380992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359364.286445:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381248 00000100:00100000:3.0:1788359364.286472:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445380992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359364.286478:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788359364.286485:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445381248:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788359364.286486:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a12a00 x1875230445380864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1788359364.286514:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359364.286516:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445380864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359364.286545:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445381248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (239us total) trans 0 rc 0/0 00010000:00080000:3.0:1788359364.286549:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c6a13480 x1875230445381248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359364.286551:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788359364.286559:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445381248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359364.286685:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445381632:0@lo:400:kworker.0 00000100:00100000:1.0:1788359364.286717:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.286736:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445382144:0@lo:400:kworker.0 00000100:00100000:1.0:1788359364.286759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.286793:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788359364.286799:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445381760:0@lo:400:kworker.0 00000100:00080000:0.0:1788359364.286803:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359364.286820:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.287895:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445381376:0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.287952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.287993:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445381888:0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.288016:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.288033:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445382400:0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.288068:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381632 00000100:00100000:3.0:1788359364.288074:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381632 00000100:00100000:3.0:1788359364.288111:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381888 00000100:00100000:3.0:1788359364.288114:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381888 00000100:00100000:3.0:1788359364.288131:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788359364.288138:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445381632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.288185:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445381632:12345-0@lo:400:kworker.0 Request processed in 47us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359364.288191:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788359364.288204:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788359364.288210:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445381888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.288246:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445381888:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359364.288251:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788359364.323521:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.323521:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445382272:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324164:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382144 00000100:00100000:0.0:1788359364.324176:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382144 00000100:00080000:0.0:1788359364.324207:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359364.324236:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445381888:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324248:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381760 00000100:00100000:0.0:1788359364.324251:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381760 00000100:00100000:2.0:1788359364.324258:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788359364.324268:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382400 00000100:00100000:2.0:1788359364.324270:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445381504:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324271:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382400 00000100:00100000:0.0:1788359364.324292:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788359364.324300:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445382144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359364.324308:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359364.324325:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445382016:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324429:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445382144:12345-0@lo:400:kworker.0 Request processed in 129us (37668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.324437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788359364.324452:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381504 00000100:00100000:0.0:1788359364.324455:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381504 00000100:00100000:0.0:1788359364.324465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788359364.324468:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445381760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324491:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445381760:12345-0@lo:400:kworker.0 Request processed in 22us (37671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.324510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788359364.324520:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788359364.324525:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445382400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359364.324547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359364.324587:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445382400:12345-0@lo:400:kworker.0 Request processed in 61us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.324592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:2.0:1788359364.324601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61bea00 x1875230445382400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359364.324603:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382016 00000100:00100000:0.0:1788359364.324606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382016 00000100:00100000:2.0:1788359364.324617:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445382400:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788359364.324629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445381504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324653:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445381504:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.324657:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788359364.324663:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445381504:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324669:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788359364.324674:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445382016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324699:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445382016:12345-0@lo:400:kworker.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359364.324701:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445382016:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.324712:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1788359364.324734:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359364.324737:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359364.325574:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445381376 00000100:00100000:0.0:1788359364.325580:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445381376 00000100:00100000:0.0:1788359364.325611:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788359364.325615:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445381376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.325653:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445381376:12345-0@lo:400:kworker.0 Request processed in 38us (37701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.325656:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788359364.325691:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445381376:0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.327565:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.331339:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445381632:0@lo:400:kworker.0 00010000:00080000:3.0:1788359364.331376:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c61bd500 x1875230445382144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359364.331389:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445382144:0@lo:400:kworker.0 00000100:00100000:3.0:1788359364.331423:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445381760:0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.331636:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382272 00000100:00100000:0.0:1788359364.331649:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382272 00000100:00100000:0.0:1788359364.331703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788359364.331712:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445382272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359364.331778:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445382272:12345-0@lo:400:kworker.0 Request processed in 67us (4220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359364.331783:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1788359364.331801:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359364.332296:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445382272:0@lo:400:kworker.0 00000004:00080000:0.0:1788359364.335842:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788359364.335894:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788359364.335906:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788359364.335940:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.335952:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.335960:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.335967:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217fe00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359364.335972:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.335981:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.335999:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffffa0eacc5ac800) 00010000:00010000:0.0:1788359364.336003:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359364.336007:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336023:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb0217fe00/0x49dd053b5feae675 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336041:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336047:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336052:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336057:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359364.336060:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336066:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336074:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffffa0eacd66ed00) 00010000:00010000:0.0:1788359364.336076:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359364.336079:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336084:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a000/0x49dd053b5feae68a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336102:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336108:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336120:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336125:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359364.336128:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336134:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336142:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa86eceed (ffffa0eacc5ac800) 00010000:00010000:0.0:1788359364.336145:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359364.336147:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336152:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae6f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa86eceed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336167:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336173:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336178:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336183:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359364.336185:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336200:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336208:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0eacc5ac600) 00010000:00010000:0.0:1788359364.336210:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359364.336213:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359364.336218:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feae70f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.336440:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359364.336457:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445382528:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788359364.336544:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.336820:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382528 00000100:00100000:3.0:1788359364.336830:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382528 00000100:00100000:3.0:1788359364.336885:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359364.336893:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445382528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788359364.336923:0:8882:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788359364.337105:0:8882:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9832be, atime: 0x6a9832be, ctime: 0x6a9832be, blocks: 0x0 00010000:00010000:3.0:1788359364.337113:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.337131:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1788359364.337136:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359364.337142:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.337158:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.337176:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.337185:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.337210:0:8882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359364.337264:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359364.337272:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.337281:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359364.337285:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.337294:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.337311:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.337319:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feae71d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.337348:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.337366:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.337369:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359364.337390:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445382528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 495us (844us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788359364.337399:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788359364.337633:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0e9c61bf100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788359364.337640:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445382528:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1788359364.438129:0:13732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8fd471b0 20000000:00000080:2.0:1788359364.438149:0:13732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0e9c75fc000 uarg=0000000000000000 20000000:01000000:2.0:1788359364.438193:0:13732:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788359364.438199:0:13732:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788359364.438203:0:13732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788359364.446272:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788359364.446408:0:13732:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788359364.450399:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788359364.450436:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788359364.450451:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788359364.450467:0:13732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788359364.450487:0:13732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450534:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450543:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450550:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450557:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450582:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450589:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450595:0:13732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450635:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.450649:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 12 pid: 6508 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359364.450665:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382656:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359364.451745:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.451757:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359364.451768:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382784:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359364.451800:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.451809:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359364.451832:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382912:0@lo:104: 00000100:00100000:3.0:1788359364.451886:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359364.451930:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 23 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.451937:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 23 pid: 6508 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359364.451946:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383040:0@lo:104: 00010000:00010000:3.0:1788359364.451973:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.451979:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359364.451986:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383168:0@lo:104: 00010000:00010000:3.0:1788359364.452010:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.452019:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359364.452019:0:8447:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788359364.452041:0:13732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383296:0@lo:104: 00000100:00100000:2.0:1788359364.452048:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.452072:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359364.452104:0:13732:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359364.452110:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359364.452128:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445382912 00000100:00100000:2.0:1788359364.452136:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445382912 00000100:00100000:2.0:1788359364.452179:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383040 00000100:00100000:2.0:1788359364.452183:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383040 00000100:00100000:2.0:1788359364.452192:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383296 00000100:00100000:2.0:1788359364.452195:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383296 00000100:00100000:2.0:1788359364.452203:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383168 00000100:00100000:2.0:1788359364.452213:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383168 00000100:00100000:2.0:1788359364.452234:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788359364.452243:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:13732:x1875230445382912:12345-0@lo:104: 00010000:00010000:2.0:1788359364.452258:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359364.452326:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788359364.452332:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+6:13732:x1875230445382912:12345-0@lo:104: Request processed in 91us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359364.452339:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788359364.452393:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359364.452402:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:13732:x1875230445383040:12345-0@lo:104: 00000100:00100000:3.0:1788359364.452410:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382912:0@lo:104: 00010000:00010000:2.0:1788359364.452411:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359364.452471:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788359364.452477:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+5:13732:x1875230445383040:12345-0@lo:104: Request processed in 77us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359364.452483:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359364.452522:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788359364.452529:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:13732:x1875230445383296:12345-0@lo:104: 00010000:00010000:2.0:1788359364.452537:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359364.452572:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788359364.452577:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+4:13732:x1875230445383296:12345-0@lo:104: Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359364.452582:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788359364.452601:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788359364.452607:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13732:x1875230445383168:12345-0@lo:104: 00010000:00010000:2.0:1788359364.452615:0:8447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359364.452978:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788359364.452984:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+3:13732:x1875230445383168:12345-0@lo:104: Request processed in 378us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359364.452991:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359364.453482:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383040:0@lo:104: 00000100:00100000:3.0:1788359364.453533:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383168:0@lo:104: 00000100:00100000:3.0:1788359364.453539:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445383296:0@lo:104: 00010000:00010000:1.0:1788359364.453926:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788359364.453935:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.453944:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359364.453948:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.453956:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359364.453964:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359364.453970:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788359364.454010:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454016:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359364.454051:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454058:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40c00/0x49dd053b5feae5d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5db expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454073:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788359364.454084:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454089:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359364.454092:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454099:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359364.454105:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359364.454111:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788359364.454124:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454130:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359364.454135:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454141:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056200/0x49dd053b5feae5c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5cd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454151:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359364.454154:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454160:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359364.454163:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454179:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359364.454185:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359364.454190:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788359364.454202:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454207:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359364.454220:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454227:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feae5aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5b1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454247:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359364.454250:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454255:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359364.454258:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454264:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359364.454270:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359364.454281:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788359364.454295:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454300:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359364.454306:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454312:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feae5b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feae5bf expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.454326:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.454328:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.454330:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.454336:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359364.454342:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359364.454365:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445383552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359364.454411:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.454444:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359364.454450:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445383424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359364.454469:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.454489:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445383808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788359364.454536:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445383680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359364.454544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359364.454577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359364.455406:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383552 00000100:00100000:1.0:1788359364.455414:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383552 00010000:00010000:1.0:1788359364.455448:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 24 pid: 6508 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.455662:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383424 00000100:00100000:1.0:1788359364.455666:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383424 00010000:00010000:1.0:1788359364.455741:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 25 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.455754:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383808 00000100:00100000:1.0:1788359364.455757:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383808 00010000:00010000:1.0:1788359364.455766:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 26 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.455776:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383680 00000100:00100000:1.0:1788359364.455778:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383680 00010000:00010000:1.0:1788359364.455790:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 27 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.455803:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788359364.455810:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+27:3643:x1875230445383552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.455824:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.455830:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 27 pid: 6508 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.455840:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 27 pid: 6508 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.455856:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031800/0x49dd053b5feae5cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae5c6 expref: 27 pid: 6508 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.455870:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.455979:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+26:3643:x1875230445383552:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.455995:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788359364.456012:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788359364.456019:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+25:3643:x1875230445383424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.456038:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.456043:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 25 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456051:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 25 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456061:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057000/0x49dd053b5feae5db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae5d4 expref: 25 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456070:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.456092:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445383424:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.456099:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788359364.456112:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788359364.456118:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3645:x1875230445383808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.456125:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.456129:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456137:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456146:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056600/0x49dd053b5feae5bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae5b8 expref: 23 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456165:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.456206:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:3645:x1875230445383808:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.456213:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788359364.456227:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359364.456233:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3644:x1875230445383680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.456242:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.456246:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 21 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456255:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 21 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456265:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae5b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feae5aa expref: 21 pid: 6510 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.456273:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.456301:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3644:x1875230445383680:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.456308:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359364.456366:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445383680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359364.462606:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445383808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788359364.463206:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445383552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359364.463385:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445383424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359364.468198:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382656:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359364.468217:0:13732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875230445382784:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359364.468262:0:13732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.472287:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359364.472344:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359364.472483:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134400 00000100:00100000:3.0:1788359364.472532:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134400 00010000:00010000:3.0:1788359364.472570:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 13 pid: 6508 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.472702:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134528 00000100:00100000:1.0:1788359364.472706:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134528 00010000:00010000:1.0:1788359364.472727:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 14 pid: 6509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359364.472774:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:1.0:1788359364.472786:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+14:2404:x1875230420134400:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.472817:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.472824:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 14 pid: 6508 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.472837:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 14 pid: 6508 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.472857:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41400/0x49dd053b5feae5e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df8 expref: 14 pid: 6508 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.472874:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.472926:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420134400:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 143us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.472933:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:1.0:1788359364.472950:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:1.0:1788359364.472956:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:2404:x1875230420134528:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359364.472963:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359364.472967:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.472976:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.472985:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feae5e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6df1 expref: 12 pid: 6509 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473002:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473010:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473025:0:10335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473032:0:10335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473040:0:10335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473047:0:10335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473053:0:10335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359364.473057:0:10335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473065:0:10335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473080:0:10335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.473090:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359364.473108:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2404:x1875230420134528:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 152us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359364.473118:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00010000:00010000:3.0:1788359364.474175:0:13732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.474190:0:13732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359364.474197:0:13732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae724 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359364.988953:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788359365.169386:0:13781:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb4e6620 20000000:00000080:2.0:1788359365.169403:0:13781:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0e9c75fdc00 uarg=0000000000000000 20000000:01000000:2.0:1788359365.169446:0:13781:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788359365.169453:0:13781:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788359365.169458:0:13781:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788359365.170462:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788359365.170914:0:13781:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788359365.170995:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788359365.171026:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788359365.171042:0:13781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788359365.171054:0:13781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788359365.171073:0:13781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171095:0:13781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171105:0:13781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171111:0:13781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171118:0:13781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171124:0:13781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171133:0:13781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359365.171137:0:13781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171145:0:13781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171157:0:13781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171164:0:13781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.171168:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7e00/0x49dd053b5feae72b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359365.951014:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359365.951023:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaff1c4000 from 7 10000000:01000000:3.0:1788359365.951029:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359365.951088:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.951103:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.951115:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359365.951144:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445383936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359365.951227:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.951305:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.951323:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445383936 00000100:00100000:1.0:1788359365.951332:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445383936 00000100:00100000:1.0:1788359365.951401:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788359365.951411:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:6512:x1875230445383936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359365.951425:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359365.951439:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eb02056800/0x49dd053b5feae739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae732 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.951464:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eb02056800/0x49dd053b5feae739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae732 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.951476:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eb02056800/0x49dd053b5feae739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae732 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.951486:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056800, rc 0) 00000100:00100000:1.0:1788359365.951720:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445383936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.951728:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788359365.952208:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445383936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359365.952226:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.952236:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359365.952306:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359365.952420:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.952526:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359365.953667:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384064 00000100:00100000:2.0:1788359365.953681:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384064 00000100:00100000:2.0:1788359365.953747:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788359365.953757:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445384064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359365.953916:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445384064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359365.953924:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788359365.954137:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359365.954188:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359365.954251:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.954293:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359365.954429:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384192 00000100:00100000:0.0:1788359365.954434:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384192 00000100:00100000:0.0:1788359365.954471:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788359365.954479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445384192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359365.954600:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445384192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359365.954608:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788359365.954693:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.955296:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13794:1875230445384320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.955366:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359365.955397:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359365.955519:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384320 00000100:00100000:2.0:1788359365.955524:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384320 00000100:00100000:2.0:1788359365.955572:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788359365.955581:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:13794:x1875230445384320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359365.955696:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:13794:x1875230445384320:12345-0@lo:502:llog_process_th.0 Request processed in 116us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359365.955703:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788359365.955784:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13794:1875230445384320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788359365.955810:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359365.955820:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.955823:0:13794:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788359365.955829:0:13794:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaff1c4000 00000020:00000080:3.0:1788359365.955832:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788359365.955900:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359365.955904:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.955905:0:13794:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788359365.955908:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359365.955910:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.955911:0:13794:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788359365.955914:0:13794:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaff1c4000 00000020:00000080:3.0:1788359365.955917:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788359365.955961:0:13794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13794:1875230445384448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359365.956007:0:13794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.956028:0:13794:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6cb5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.956641:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384448 00000100:00100000:1.0:1788359365.956647:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384448 00000100:00100000:1.0:1788359365.956681:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788359365.956688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:13794:x1875230445384448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.956787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:13794:x1875230445384448:12345-0@lo:502:llog_process_th.0 Request processed in 98us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.956794:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788359365.958024:0:13794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13794:1875230445384448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788359365.958057:0:13794:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359365.958064:0:13794:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.958066:0:13794:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788359365.958070:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788359365.959207:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788359365.959236:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788359365.959247:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.959259:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359365.959269:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788359365.959272:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6d76800 from 7 10000000:01000000:1.0:1788359365.959274:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788359365.959305:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.959326:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.959344:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359365.959368:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.959422:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359365.959459:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff2026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359365.960513:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384576 00000100:00100000:3.0:1788359365.960524:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384576 00000100:00100000:3.0:1788359365.960590:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788359365.960610:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:6512:x1875230445384576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359365.960629:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359365.960647:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feae747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae740 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.960677:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feae747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae740 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.960688:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feae747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae740 expref: 22 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359365.960697:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7c00, rc 0) 00000100:00100000:3.0:1788359365.960752:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445384576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359365.960759:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788359365.963149:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359365.963181:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359365.963203:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359365.963293:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.963442:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359365.963518:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff2026c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359365.963861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384704 00000100:00100000:3.0:1788359365.963868:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384704 00000100:00100000:3.0:1788359365.963919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788359365.963927:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445384704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359365.964076:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445384704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359365.964084:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788359365.966959:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.967034:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.967110:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359365.967149:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff2026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.967168:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384832 00000100:00100000:1.0:1788359365.967173:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384832 00000100:00100000:1.0:1788359365.967222:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788359365.967230:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445384832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.967538:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445384832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.967545:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788359365.967603:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445384832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.967792:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13796:1875230445384960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.967827:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359365.967846:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445384960 00000100:00100000:1.0:1788359365.967850:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445384960 00000100:00100000:1.0:1788359365.967872:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788359365.967878:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:13796:x1875230445384960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.967970:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:13796:x1875230445384960:12345-0@lo:502:llog_process_th.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359365.970896:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.971424:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788359365.973532:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13796:1875230445384960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359365.973608:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359365.973628:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359365.973631:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359365.973639:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaf6d76800 00000020:00000080:2.0:1788359365.973642:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788359365.973711:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359365.973715:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359365.973721:0:13796:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359365.973724:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359365.973727:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359365.973729:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788359365.973732:0:13796:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaf6d76800 00000020:00000080:2.0:1788359365.973734:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359365.973799:0:13796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13796:1875230445385088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359365.973897:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359365.973951:0:13796:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.974710:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385088 00000100:00100000:1.0:1788359365.974728:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385088 00000100:00100000:1.0:1788359365.974775:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788359365.974783:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:13796:x1875230445385088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.974907:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:13796:x1875230445385088:12345-0@lo:502:llog_process_th.0 Request processed in 125us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.974915:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788359365.984866:0:13796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13796:1875230445385088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359365.984913:0:13796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359365.984922:0:13796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359365.984925:0:13796:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788359365.984929:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788359365.985100:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788359365.985125:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359365.985146:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985159:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359365.985170:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788359365.985174:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaf6cef800 from 7 10000000:01000000:0.0:1788359365.985176:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359365.985215:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985223:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985232:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359365.985256:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359365.985405:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359365.985458:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359365.985548:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385216 00000100:00100000:2.0:1788359365.985555:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385216 00000100:00100000:0.0:1788359365.985644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788359365.985654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:6512:x1875230445385216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359365.985668:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359365.985682:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14b800/0x49dd053b5feae755 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae74e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985704:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14b800/0x49dd053b5feae755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae74e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985741:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14b800/0x49dd053b5feae755 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae74e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985750:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b800, rc 0) 00000100:00100000:0.0:1788359365.985790:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359365.985803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788359365.985847:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359365.985859:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359365.985869:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359365.985927:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359365.986196:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359365.986225:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.986697:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385344 00000100:00100000:1.0:1788359365.986703:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385344 00000100:00100000:1.0:1788359365.986746:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788359365.986755:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359365.986905:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.986913:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788359365.987455:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359365.987519:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359365.987580:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359365.987609:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359365.988448:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385472 00000100:00100000:2.0:1788359365.988459:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385472 00000100:00100000:2.0:1788359365.988529:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788359365.988538:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359365.988664:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359365.988671:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788359365.989541:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788359365.992998:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788359365.993265:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13799:1875230445385600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359365.993361:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.993394:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaffaa0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359365.993568:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385600 00000100:00100000:1.0:1788359365.993577:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385600 00000100:00100000:1.0:1788359365.993620:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788359365.993630:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:13799:x1875230445385600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359365.993758:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:13799:x1875230445385600:12345-0@lo:502:llog_process_th.0 Request processed in 129us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359365.993766:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788359365.995883:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13799:1875230445385600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788359365.995925:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359365.995936:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.995939:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788359365.995959:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaf6cef800 00000020:00000080:3.0:1788359365.995961:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788359365.996183:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359365.996187:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.996188:0:13799:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788359365.996191:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359365.996194:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359365.996196:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788359365.996199:0:13799:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaf6cef800 00000020:00000080:3.0:1788359365.996201:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788359365.996252:0:13799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13799:1875230445385728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359365.997112:0:13799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359365.997162:0:13799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c01780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359365.997683:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385728 00000100:00100000:2.0:1788359365.997692:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385728 00000100:00100000:2.0:1788359365.997749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788359365.997758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:13799:x1875230445385728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359365.997901:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:13799:x1875230445385728:12345-0@lo:502:llog_process_th.0 Request processed in 142us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359365.997908:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788359365.998080:0:13799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13799:1875230445385728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788359365.998112:0:13799:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359365.998119:0:13799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359365.998121:0:13799:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788359365.998127:0:13799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788359365.999159:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788359365.999190:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359365.999201:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359365.999213:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359365.999224:0:6512:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359365.999233:0:6512:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eae4e42000 from 7 10000000:01000000:2.0:1788359365.999236:0:6512:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359365.999270:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359365.999278:0:6512:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359365.999287:0:6512:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359365.999306:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359365.999693:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359365.999745:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788359365.999911:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385856 00000100:00100000:3.0:1788359365.999918:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385856 00000100:00100000:3.0:1788359365.999975:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788359366.000052:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:6512:x1875230445385856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359366.000067:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359366.000081:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feae763 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feae75c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359366.000104:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feae763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feae75c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359366.000115:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feae763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feae75c expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359366.000136:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6600, rc 0) 00000100:00100000:3.0:1788359366.000189:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445385856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.000195:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788359366.000412:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359366.000428:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359366.000445:0:6512:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359366.000535:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359366.000567:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359366.000585:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359366.000648:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445385984 00000100:00100000:2.0:1788359366.000653:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445385984 00000100:00100000:2.0:1788359366.000688:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788359366.000695:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445385984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359366.000803:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445385984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.000810:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788359366.000836:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445385984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359366.000865:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445386112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359366.000902:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359366.000917:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359366.000932:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386112 00000100:00100000:2.0:1788359366.000935:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386112 00000100:00100000:2.0:1788359366.001630:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788359366.001645:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445386112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359366.001754:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:6512:x1875230445386112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.001762:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788359366.002297:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8a40c955-5ca1-4b36-8930-3bb8957fb20c:6512:1875230445386112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359366.009711:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13800:1875230445386240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359366.009916:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359366.009980:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359366.010138:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386240 00000100:00100000:1.0:1788359366.010147:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386240 00000100:00100000:1.0:1788359366.010208:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788359366.010219:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:13800:x1875230445386240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359366.010379:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:13800:x1875230445386240:12345-0@lo:502:llog_process_th.0 Request processed in 160us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.010387:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788359366.011142:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13800:1875230445386240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359366.011178:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359366.011190:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359366.011192:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359366.011200:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eae4e42000 00000020:00000080:2.0:1788359366.011203:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788359366.011265:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359366.011269:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359366.011271:0:13800:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359366.011274:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359366.011277:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359366.011278:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788359366.011283:0:13800:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eae4e42000 00000020:00000080:2.0:1788359366.011285:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788359366.011326:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13800:1875230445386368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359366.011385:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359366.011427:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c636ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359366.013112:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386368 00000100:00100000:3.0:1788359366.013127:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386368 00000100:00100000:3.0:1788359366.013192:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788359366.013203:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:13800:x1875230445386368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359366.013400:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:13800:x1875230445386368:12345-0@lo:502:llog_process_th.0 Request processed in 199us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.013407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:2.0:1788359366.014207:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359366.015023:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8a40c955-5ca1-4b36-8930-3bb8957fb20c:13800:1875230445386368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788359366.015064:0:13800:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359366.015136:0:13800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359366.015139:0:13800:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788359366.015147:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788359366.016418:0:6512:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788359366.016453:0:6512:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359366.016466:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359366.016480:0:6512:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788359366.018328:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788359366.081321:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359366.081372:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134656 00000100:00100000:0.0:1788359366.081376:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359366.081381:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134656 00000100:00100000:3.0:1788359366.081435:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 357 00000100:00100000:3.0:1788359366.081445:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2402:x1875230420134656:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359366.081529:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134784 00000100:00100000:2.0:1788359366.081535:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134784 00000100:00100000:3.0:1788359366.081555:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2402:x1875230420134656:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.081565:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 357 00000100:00080000:0.0:1788359366.081594:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359366.081600:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 227 00000100:00100000:2.0:1788359366.081617:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420134784:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359366.081654:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420134784:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.081660:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 227 00000100:00100000:1.0:1788359366.086283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.086326:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.086368:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.086394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.086423:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135296 00000100:00100000:1.0:1788359366.086432:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135296 00000100:00100000:3.0:1788359366.086509:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420134912 00000100:00100000:1.0:1788359366.086512:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135168 00000100:00100000:3.0:1788359366.086514:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420134912 00000100:00100000:1.0:1788359366.086514:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135168 00000100:00100000:1.0:1788359366.086543:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 228 00000100:00100000:3.0:1788359366.086549:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 229 00000100:00100000:1.0:1788359366.086552:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420135296:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359366.086555:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420135168:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359366.086598:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135040 00000100:00100000:2.0:1788359366.086604:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135040 00000100:00100000:3.0:1788359366.086626:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420135168:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 69us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.086635:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 229 00000100:00100000:2.0:1788359366.086645:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:0.0:1788359366.086652:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 230 00000100:00100000:2.0:1788359366.086657:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420135040:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359366.086665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420134912:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359366.086722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420135296:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 172us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.086727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 228 00000100:00080000:1.0:1788359366.086745:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359366.086749:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788359366.086750:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359366.093261:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420135040:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 6595us (6975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.093276:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:1.0:1788359366.094870:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420134912:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 8197us (8489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.094887:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 230 00000100:00100000:1.0:1788359366.213431:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359366.213547:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135424 00000100:00100000:2.0:1788359366.213556:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135424 00000100:00100000:2.0:1788359366.213612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 358 00000100:00100000:2.0:1788359366.213622:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:6175:x1875230420135424:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359366.213638:0:6508:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359366.213665:0:6508:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feae76a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e45 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359366.213695:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feae76a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e45 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359366.213707:0:6508:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feae76a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e45 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359366.213718:0:6508:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea200, rc 0) 00000100:00100000:2.0:1788359366.213780:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420135424:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.213807:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 358 00000100:00100000:2.0:1788359366.224390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359366.224463:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135552 00000100:00100000:3.0:1788359366.224475:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135552 00000100:00100000:3.0:1788359366.224593:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 359 00000100:00100000:3.0:1788359366.224603:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420135552:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359366.224756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420135552:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 154us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.224765:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 359 00000100:00100000:1.0:1788359366.229569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359366.230404:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135680 00000100:00100000:0.0:1788359366.230416:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135680 00000100:00100000:0.0:1788359366.230475:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 360 00000100:00100000:0.0:1788359366.230484:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420135680:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359366.230680:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420135680:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 195us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359366.230689:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 360 00000100:00100000:1.0:1788359366.239800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359366.243112:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135808 00000100:00100000:3.0:1788359366.243148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135808 00000100:00100000:3.0:1788359366.243234:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 361 00000100:00100000:3.0:1788359366.243245:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:10807:x1875230420135808:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788359366.243465:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:10807:x1875230420135808:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 219us (3696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.243474:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 361 00000100:00100000:3.0:1788359366.247685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359366.247909:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420135936 00000100:00100000:2.0:1788359366.247927:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420135936 00000100:00100000:2.0:1788359366.247989:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 362 00000100:00100000:2.0:1788359366.247998:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:10807:x1875230420135936:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359366.248158:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:10807:x1875230420135936:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 159us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.248166:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 362 00000100:00100000:1.0:1788359366.260901:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359366.261031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136064 00000100:00100000:0.0:1788359366.261041:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136064 00000100:00100000:0.0:1788359366.262814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 363 00000100:00100000:0.0:1788359366.262835:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:6175:x1875230420136064:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359366.262853:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359366.262871:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae771 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e4c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359366.262901:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e4c expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359366.262913:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e4c expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359366.262934:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14be00, rc 0) 00000100:00100000:0.0:1788359366.263001:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420136064:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 175us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359366.263009:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 363 00000100:00100000:1.0:1788359366.266154:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359366.266311:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136192 00000100:00100000:3.0:1788359366.266322:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136192 00000100:00100000:3.0:1788359366.266391:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 364 00000100:00100000:3.0:1788359366.266402:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420136192:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359366.266573:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420136192:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 173us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359366.266579:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 364 00000100:00100000:3.0:1788359366.268264:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.268316:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136320 00000100:00100000:1.0:1788359366.268326:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136320 00000100:00100000:1.0:1788359366.268433:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 365 00000100:00100000:1.0:1788359366.268444:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420136320:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788359366.268606:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:6175:x1875230420136320:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 163us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.268614:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 365 00000100:00100000:1.0:1788359366.283767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359366.286856:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136448 00000100:00100000:2.0:1788359366.286873:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136448 00000100:00100000:2.0:1788359366.287115:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 366 00000100:00100000:2.0:1788359366.287128:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:10810:x1875230420136448:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359366.287295:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:10810:x1875230420136448:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 168us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359366.287306:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 366 00000100:00100000:2.0:1788359366.329342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359366.329418:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136576 00000100:00100000:1.0:1788359366.329429:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136576 00000100:00100000:1.0:1788359366.329490:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 367 00000100:00100000:1.0:1788359366.329543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:10810:x1875230420136576:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788359366.329700:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:10810:x1875230420136576:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 159us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.329709:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 367 00000100:00100000:0.0:1788359366.845188:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445386496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359366.845275:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359366.845489:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386496 00000100:00100000:1.0:1788359366.845546:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386496 00000100:00100000:1.0:1788359366.845606:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788359366.845619:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445386496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359366.845666:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359366.845725:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445386496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359366.845746:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788359366.846015:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445386496:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788359367.039238:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788359367.039635:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788359367.039914:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359367.357131:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445386624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359367.357235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359367.357719:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386624 00000100:00100000:1.0:1788359367.357730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386624 00000100:00100000:1.0:1788359367.357798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788359367.357807:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445386624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359367.357847:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788359367.370365:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445386624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12542us (13113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359367.370381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788359367.376706:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445386624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359368.065121:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359369.084750:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359369.405908:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445386880:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.405979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406048:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445387392:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406092:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445387904:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406113:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445388416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359369.406165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406187:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788359369.406194:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445386752:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406246:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445387264:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406267:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406285:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445387776:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406318:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406333:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445388288:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.406382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387264 00000100:00100000:2.0:1788359369.406390:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387264 00000100:00100000:2.0:1788359369.406432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788359369.406441:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445387264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406520:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445387264:12345-0@lo:400:kworker.0 Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359369.406529:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788359369.406556:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445387008:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.406581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359369.406893:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386752 00000100:00100000:0.0:1788359369.406899:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386752 00000100:00100000:0.0:1788359369.406927:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788359369.406933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445386752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359369.406967:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445386752:12345-0@lo:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359369.406973:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788359369.407047:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445386752:0@lo:400:kworker.0 00000100:00100000:0.0:1788359369.407060:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445387264:0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.407151:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445386880 00000100:00100000:1.0:1788359369.407155:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445386880 00000100:00100000:1.0:1788359369.407195:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387392 00000100:00100000:1.0:1788359369.407198:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387392 00000100:00100000:1.0:1788359369.407226:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387904 00000100:00100000:1.0:1788359369.407229:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387904 00000100:00100000:1.0:1788359369.407244:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788359369.407251:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445386880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.407291:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445386880:12345-0@lo:400:kworker.0 Request processed in 41us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.407297:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788359369.407323:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788359369.407330:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445387392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.407358:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445387392:12345-0@lo:400:kworker.0 Request processed in 29us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.407363:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788359369.407375:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788359369.407381:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445387904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.407419:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445387904:12345-0@lo:400:kworker.0 Request processed in 39us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.407425:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788359369.407449:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388416 00000100:00100000:1.0:1788359369.407452:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388416 00000100:00100000:1.0:1788359369.407479:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788359369.407486:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445388416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359369.407526:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359369.407558:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445388416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.407563:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788359369.407579:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387776 00000100:00100000:1.0:1788359369.407581:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387776 00000100:00100000:1.0:1788359369.407921:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388288 00000100:00100000:1.0:1788359369.407926:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388288 00000100:00100000:1.0:1788359369.407953:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788359369.407960:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445387776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408116:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788359369.408125:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445388288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408171:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445388288:12345-0@lo:400:kworker.0 Request processed in 48us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359369.408177:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788359369.408257:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445388800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359369.408285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359369.408331:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445387136:0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408374:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359369.408394:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445387648:0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408415:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359369.408450:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387648 00000100:00100000:3.0:1788359369.408454:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387648 00000100:00100000:3.0:1788359369.408475:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788359369.408481:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445387648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408525:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445387648:12345-0@lo:400:kworker.0 Request processed in 44us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359369.408531:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788359369.408560:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445387648:0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408566:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445388160:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.408863:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445387520:0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.408904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359369.412118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387136 00000100:00100000:0.0:1788359369.412135:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387136 00000100:00100000:0.0:1788359369.412200:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788359369.412210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445387136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419233:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445387776:12345-0@lo:400:kworker.0 Request processed in 11263us (12904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.419249:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788359369.419280:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388160 00000100:00100000:1.0:1788359369.419288:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388160 00000100:00100000:1.0:1788359369.419349:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788359369.419357:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445388160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419401:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445388160:12345-0@lo:400:kworker.0 Request processed in 45us (10496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.419407:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788359369.419448:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788359369.419453:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359369.419456:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359369.419524:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445387776:0@lo:400:kworker.0 00010000:00080000:1.0:1788359369.419544:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb80e00 x1875230445388288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359369.419554:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445388288:0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419569:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445386880:0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419580:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445387392:0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419589:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445387904:0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419627:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445388416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359369.419665:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387008 00000100:00100000:1.0:1788359369.419668:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387008 00000100:00100000:1.0:1788359369.419693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788359369.419698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445387008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.419743:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445387008:12345-0@lo:400:kworker.0 Request processed in 44us (13161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.419749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788359369.419894:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388800 00000100:00100000:1.0:1788359369.419898:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388800 00000100:00100000:1.0:1788359369.419923:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788359369.419929:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445388800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359369.419949:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359369.419987:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445388800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (11701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.420000:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1788359369.420057:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaece0ce00 x1875230445388800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359369.420071:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445388800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359369.424519:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.424580:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445388032:0@lo:400:kworker.0 00000100:00100000:2.0:1788359369.424713:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.424756:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445388544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359369.424953:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445387520 00000100:00100000:1.0:1788359369.424962:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445387520 00000100:00100000:1.0:1788359369.425023:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388032 00000100:00100000:1.0:1788359369.425026:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388032 00000100:00100000:1.0:1788359369.425053:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788359369.425061:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445387520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.425114:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445387520:12345-0@lo:400:kworker.0 Request processed in 54us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.425122:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788359369.425137:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788359369.425146:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445388032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359369.425173:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445388032:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359369.425179:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1788359369.425196:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359369.425352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.425397:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445387008:0@lo:400:kworker.0 00010000:00080000:2.0:1788359369.425410:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac6680 x1875230445387520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359369.425420:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445387520:0@lo:400:kworker.0 00010000:00080000:2.0:1788359369.425429:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb83b80 x1875230445388032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359369.425437:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445388032:0@lo:400:kworker.0 00010000:00080000:3.0:1788359369.430856:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb83800 x1875230445388160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359369.430876:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445388160:0@lo:400:kworker.0 00000100:00100000:3.0:1788359369.430890:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445388672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359369.430950:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359369.431143:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388544 00000100:00100000:2.0:1788359369.431150:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388544 00000100:00100000:2.0:1788359369.431201:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388672 00000100:00100000:2.0:1788359369.431204:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388672 00000100:00100000:2.0:1788359369.431220:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359369.431228:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445388544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359369.431252:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359369.431312:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445388544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (6510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359369.431320:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359369.431337:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788359369.431344:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445388672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359369.431354:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359369.431383:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445388672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359369.431388:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788359369.431435:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaece0e680 x1875230445388544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359369.431450:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445388544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359369.433034:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445388672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359369.441915:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445387136:12345-0@lo:400:kworker.0 Request processed in 29694us (33532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359369.441934:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788359369.442277:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445387136:0@lo:400:kworker.0 00000001:00080000:0.0:1788359369.919406:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1788359370.108925:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359371.133484:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359371.194803:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359371.197079:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136832 00000100:00100000:2.0:1788359371.197096:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136832 00000100:00100000:2.0:1788359371.197206:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 237 00000100:00100000:2.0:1788359371.197220:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420136832:12345-192.168.202.52@tcp:400:kworker.0 00000100:00080000:1.0:1788359371.197235:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359371.197329:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420136832:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 113us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359371.197337:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 237 00000100:00100000:3.0:1788359371.204102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359371.204139:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359371.204176:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359371.204259:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136704 00000100:00100000:0.0:1788359371.204270:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136704 00000100:00100000:2.0:1788359371.204272:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137344 00000100:00100000:2.0:1788359371.204279:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137344 00000100:00100000:0.0:1788359371.204344:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 369 00000100:00100000:2.0:1788359371.204349:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 238 00000100:00100000:0.0:1788359371.204356:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420136704:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359371.204364:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420137344:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359371.204427:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420137344:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359371.204437:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 238 00000100:00100000:1.0:1788359371.204446:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137088 00000100:00100000:1.0:1788359371.204450:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137088 00000100:00100000:1.0:1788359371.204479:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 75 00000100:00100000:1.0:1788359371.204488:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137088:12345-192.168.202.52@tcp:400:kworker.0 00000100:00080000:3.0:1788359371.204599:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359371.204605:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359371.207090:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420136704:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 2720us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359371.207103:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 369 00000100:00100000:1.0:1788359371.207229:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137088:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 2741us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359371.207237:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 75 00000100:00100000:3.0:1788359371.210332:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359371.210488:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420136960 00000100:00100000:0.0:1788359371.210516:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420136960 00000100:00080000:1.0:1788359371.210675:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359371.210733:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359371.210801:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137216 00000100:00100000:2.0:1788359371.210807:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137216 00000100:00100000:2.0:1788359371.210861:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 239 00000100:00100000:2.0:1788359371.210871:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420137216:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359371.210940:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420137216:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359371.210946:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 239 00000100:00080000:1.0:1788359371.211025:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359371.211200:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 240 00000100:00100000:0.0:1788359371.211207:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420136960:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359371.211236:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420136960:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 31us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359371.211242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 240 00000100:00100000:3.0:1788359371.964890:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359371.964916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445388928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359371.964993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359371.965175:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445388928 00000100:00100000:2.0:1788359371.965199:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445388928 00000100:00100000:2.0:1788359371.965251:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788359371.965260:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445388928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359371.965306:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359371.965368:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445388928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359371.965377:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788359371.965417:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445388928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359372.156998:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359372.478884:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359372.478920:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445389056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359372.479029:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359372.479715:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389056 00000100:00100000:1.0:1788359372.479726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389056 00000100:00100000:1.0:1788359372.479789:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788359372.479799:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445389056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359372.479839:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788359372.479910:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445389056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359372.479918:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788359372.480772:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445389056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359373.181160:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359374.204995:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359374.524938:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359374.524960:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445389184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359374.525041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.525103:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389184 00000100:00100000:2.0:1788359374.525111:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389184 00000100:00100000:2.0:1788359374.525157:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359374.525166:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445389184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359374.525195:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359374.525247:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445389184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359374.525264:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359374.525315:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445389184:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788359374.525737:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359374.525935:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359374.525948:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445389312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359374.525983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359374.526194:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389312 00000100:00100000:1.0:1788359374.526199:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389312 00000100:00100000:1.0:1788359374.526247:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788359374.526268:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445389312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359374.526288:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359374.526362:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359374.526373:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445389440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359374.526616:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445389568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359374.541785:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445389312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15521us (15791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.541802:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788359374.541860:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359374.541899:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445389696:0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.542535:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359374.542597:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445390208:0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.542628:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359374.542648:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445390720:0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.542675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359374.542789:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389696 00000100:00100000:1.0:1788359374.542797:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389696 00000100:00100000:1.0:1788359374.542974:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788359374.542985:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445389696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.543052:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae544f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445389696:12345-0@lo:400:kworker.0 Request processed in 69us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.543060:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788359374.543094:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390208 00000100:00100000:1.0:1788359374.543097:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390208 00000100:00100000:1.0:1788359374.543125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788359374.543132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.543167:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445390208:12345-0@lo:400:kworker.0 Request processed in 36us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.543173:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788359374.543190:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390720 00000100:00100000:1.0:1788359374.543194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390720 00000100:00100000:1.0:1788359374.543268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788359374.543276:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445390720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359374.543321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445390720:12345-0@lo:400:kworker.0 Request processed in 47us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.543328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788359374.543674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.543722:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445389824:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.543750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.543778:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445390336:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.543799:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.543823:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445390848:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.543853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.543872:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389824 00000100:00100000:2.0:1788359374.543875:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389824 00000100:00100000:2.0:1788359374.543896:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390336 00000100:00100000:2.0:1788359374.543899:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390336 00000100:00100000:2.0:1788359374.543911:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390848 00000100:00100000:2.0:1788359374.543913:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390848 00000100:00100000:2.0:1788359374.543938:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788359374.543944:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445389824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.543973:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445389824:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359374.543979:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788359374.543992:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788359374.544010:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445390336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544038:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445390336:12345-0@lo:400:kworker.0 Request processed in 42us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359374.544045:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788359374.544056:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788359374.544061:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445390848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544083:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445390848:12345-0@lo:400:kworker.0 Request processed in 22us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359374.544088:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:2.0:1788359374.544119:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb82a00 x1875230445390848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359374.544143:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445390848:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544164:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445389824:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544172:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445390336:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544183:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359374.544190:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445389952:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544477:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.544522:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389952 00000100:00100000:2.0:1788359374.544526:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389952 00000100:00100000:2.0:1788359374.544552:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359374.544558:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445389952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544591:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445389952:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359374.544597:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359374.544619:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445389952:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544625:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445390464:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.544646:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.544662:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390464 00000100:00100000:2.0:1788359374.544665:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390464 00000100:00100000:2.0:1788359374.545142:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788359374.545153:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445390464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.545187:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445390464:12345-0@lo:400:kworker.0 Request processed in 37us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.547110:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389440 00000100:00100000:1.0:1788359374.547124:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389440 00000100:00100000:1.0:1788359374.547567:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788359374.547578:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445389440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359374.547603:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359374.547869:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00080000:2.0:1788359374.547959:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb80380 x1875230445390464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359374.547974:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445390464:0@lo:400:kworker.0 00000100:00100000:2.0:1788359374.547986:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445390976:0@lo:400:kworker.0 00010000:00080000:3.0:1788359374.548519:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7241c00 x1875230445389312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359374.548536:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445389312:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788359374.548597:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359374.548602:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359374.548605:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359374.548631:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445389696:0@lo:400:kworker.0 00000100:00100000:3.0:1788359374.548657:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445390208:0@lo:400:kworker.0 00000100:00100000:3.0:1788359374.548670:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445390720:0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.562941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359374.563012:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445390080:0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.563056:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359374.563087:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.563112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359374.563147:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390592 00000100:00100000:0.0:1788359374.563157:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390592 00000100:00100000:0.0:1788359374.563227:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788359374.563236:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445390592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.563308:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445390592:12345-0@lo:400:kworker.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359374.563315:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788359374.563365:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788359374.563372:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0e9c61bf100, transno 4294967301 00000100:00100000:0.0:1788359374.563386:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445390592:0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.563556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390080 00000100:00100000:0.0:1788359374.563560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390080 00000100:00100000:0.0:1788359374.563594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788359374.563602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445390080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359374.563641:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445390080:12345-0@lo:400:kworker.0 Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359374.563647:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788359374.563674:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445390080:0@lo:400:kworker.0 00000100:00100000:3.0:1788359374.566230:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445389568 00000100:00100000:3.0:1788359374.566245:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445389568 00000100:00100000:3.0:1788359374.566352:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788359374.566362:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445389568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359374.566404:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359374.566489:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445389568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359374.566525:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788359374.568232:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788359374.568316:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb83100 x1875230445389568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359374.568556:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445389568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359374.572546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445389440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 24959us (28860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359374.572561:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359374.575679:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359374.575762:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445389440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359374.578899:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445390976 00000100:00100000:3.0:1788359374.578914:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445390976 00000100:00100000:3.0:1788359374.578993:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788359374.579003:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445390976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359374.579116:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445390976:12345-0@lo:400:kworker.0 Request processed in 115us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359374.579124:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788359374.582362:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb81880 x1875230445390976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359374.582384:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445390976:0@lo:400:kworker.0 00010000:00010000:2.0:1788359375.229986:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359376.254340:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359376.333564:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333621:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333647:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333681:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333706:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333735:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359376.333763:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137600 00000100:00100000:3.0:1788359376.333773:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137600 00000100:00100000:3.0:1788359376.333829:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137728 00000100:00100000:3.0:1788359376.333832:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137728 00000100:00100000:3.0:1788359376.333846:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137984 00000100:00100000:3.0:1788359376.333848:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137984 00000100:00100000:3.0:1788359376.333860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138112 00000100:00100000:3.0:1788359376.333863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138112 00000100:00100000:3.0:1788359376.333877:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 247 00000100:00100000:3.0:1788359376.333885:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137600:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359376.333885:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:1.0:1788359376.333895:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420137728:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359376.333958:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420137728:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 64us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359376.333965:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:2.0:1788359376.333979:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 249 00000100:00100000:1.0:1788359376.333983:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 250 00000100:00100000:2.0:1788359376.333987:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420137984:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359376.333988:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420138112:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359376.334051:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137472 00000100:00100000:0.0:1788359376.334057:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137472 00000100:00100000:0.0:1788359376.334093:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 371 00000100:00100000:0.0:1788359376.334099:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420137472:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359376.338577:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137600:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 4480us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359376.338577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420138112:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 4578us (4831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359376.338594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 250 00000100:00100000:3.0:1788359376.338600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 247 00000100:00100000:3.0:1788359376.338752:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420137856 00000100:00100000:3.0:1788359376.338762:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420137856 00000100:00080000:1.0:1788359376.338779:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788359376.338785:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359376.338787:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359376.338820:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:3.0:1788359376.338828:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137856:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359376.338885:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420137856:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 57us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359376.338892:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:2.0:1788359376.343790:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420137984:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 9790us (10094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359376.343790:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420137472:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 9677us (10154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359376.343816:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 371 00000100:00100000:2.0:1788359376.343817:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 249 00000100:00100000:3.0:1788359377.084772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445391104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359377.084850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359377.096747:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391104 00000100:00100000:2.0:1788359377.096765:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391104 00000100:00100000:2.0:1788359377.096911:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788359377.096923:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445391104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359377.096966:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359377.097069:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445391104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (12218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359377.097077:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788359377.097191:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445391104:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788359377.277917:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788359377.278134:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788359377.279635:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788359377.601635:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445391232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359377.601713:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359377.602097:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391232 00000100:00100000:0.0:1788359377.602105:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391232 00000100:00100000:0.0:1788359377.602162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788359377.602172:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445391232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359377.602207:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359377.602513:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445391232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 321us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359377.602521:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788359377.608129:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445391232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359378.300762:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359379.324868:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359379.649112:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359379.649141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445391360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359379.649227:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.649433:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391360 00000100:00100000:3.0:1788359379.649440:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391360 00000100:00100000:3.0:1788359379.649491:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788359379.649517:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445391360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359379.649544:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359379.649587:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445391360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.649592:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788359379.649739:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445391488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359379.649767:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788359379.649813:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb009f3800 x1875230445391360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359379.649853:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445391360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359379.649915:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391488 00000100:00100000:3.0:1788359379.649920:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391488 00000100:00100000:3.0:1788359379.649964:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788359379.649969:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445391488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359379.649980:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359379.650011:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445391488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.650016:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788359379.650087:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359379.650252:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445391744:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650312:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445392256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650333:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650355:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445392768:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650392:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788359379.650397:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445391616:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650421:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650439:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445392128:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650475:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445392640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650514:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359379.650540:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392640 00000100:00100000:3.0:1788359379.650544:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392640 00000100:00100000:3.0:1788359379.650576:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788359379.650583:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445392640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650619:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445392640:12345-0@lo:400:kworker.0 Request processed in 37us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.650636:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788359379.650654:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391744 00000100:00100000:3.0:1788359379.650658:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391744 00000100:00100000:3.0:1788359379.650681:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392256 00000100:00100000:3.0:1788359379.650684:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392256 00000100:00100000:3.0:1788359379.650698:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392768 00000100:00100000:3.0:1788359379.650700:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392768 00000100:00100000:3.0:1788359379.650715:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788359379.650721:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445391744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650753:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445391744:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.650759:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788359379.650770:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788359379.650776:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445392256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650803:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445392256:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.650808:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788359379.650818:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788359379.650823:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445392768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650847:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445392768:12345-0@lo:400:kworker.0 Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359379.650852:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00080000:3.0:1788359379.650870:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359379.650873:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359379.650897:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445392640:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650906:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445391744:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650924:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445392256:0@lo:400:kworker.0 00000100:00100000:3.0:1788359379.650932:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445392768:0@lo:400:kworker.0 00000100:00100000:1.0:1788359379.651085:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391616 00000100:00100000:1.0:1788359379.651089:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391616 00000100:00100000:1.0:1788359379.651124:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788359379.651131:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445391616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359379.651179:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445391616:12345-0@lo:400:kworker.0 Request processed in 49us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359379.651185:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788359379.651230:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445391616:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651453:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445391872:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651488:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.651526:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445392384:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651546:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.651563:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445392896:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651582:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.651600:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788359379.651606:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445392000:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651626:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.651646:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445392512:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651668:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.651716:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392384 00000100:00100000:2.0:1788359379.651720:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392384 00000100:00100000:2.0:1788359379.651748:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392896 00000100:00100000:2.0:1788359379.651751:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392896 00000100:00100000:2.0:1788359379.651763:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392000 00000100:00100000:2.0:1788359379.651766:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392000 00000100:00100000:2.0:1788359379.651778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788359379.651784:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445392384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651817:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445392384:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.651823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788359379.651834:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788359379.651840:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445392896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651866:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445392896:12345-0@lo:400:kworker.0 Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.651879:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788359379.651890:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788359379.651895:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445392000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.651920:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445392000:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.651925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:2.0:1788359379.651937:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359379.651946:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392128 00000100:00100000:2.0:1788359379.651949:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392128 00000100:00100000:2.0:1788359379.651967:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445391872 00000100:00100000:2.0:1788359379.651969:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445391872 00000100:00100000:2.0:1788359379.651977:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788359379.651982:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445392128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.652013:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445392128:12345-0@lo:400:kworker.0 Request processed in 30us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.652018:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788359379.652029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788359379.652034:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445391872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.652057:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445391872:12345-0@lo:400:kworker.0 Request processed in 24us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.652062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788359379.652102:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445392000:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.652111:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445391872:0@lo:400:kworker.0 00010000:00080000:2.0:1788359379.652120:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7798a80 x1875230445392384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359379.652141:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445392384:0@lo:400:kworker.0 00010000:00080000:2.0:1788359379.652153:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaece0e680 x1875230445392896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359379.652160:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445392896:0@lo:400:kworker.0 00000100:00100000:2.0:1788359379.652173:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359379.652181:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359379.652395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359379.652427:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393024 00000100:00100000:2.0:1788359379.652431:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393024 00000100:00100000:2.0:1788359379.652460:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788359379.652467:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359379.652489:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359379.652543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359379.652549:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788359379.652563:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359379.652592:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359379.652677:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445392512 00000100:00100000:0.0:1788359379.652681:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445392512 00000100:00100000:0.0:1788359379.652730:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788359379.652737:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445392512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359379.652775:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445392512:12345-0@lo:400:kworker.0 Request processed in 39us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359379.652781:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1788359379.652817:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eb009f1880 x1875230445391488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359379.652830:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445391488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359379.652854:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788359379.653099:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445392128:0@lo:400:kworker.0 00000100:00100000:1.0:1788359379.653110:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359379.653115:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445393152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359379.653143:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359379.653267:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393152 00000100:00100000:0.0:1788359379.653272:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393152 00000100:00100000:0.0:1788359379.653303:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788359379.653309:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445393152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788359379.653319:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359379.653347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445393152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359379.653352:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788359379.653476:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445393152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788359380.348723:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359381.373575:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359381.445485:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359381.445557:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138240 00000100:00100000:3.0:1788359381.445566:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359381.445567:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138240 00000100:00100000:3.0:1788359381.445604:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359381.445639:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 373 00000100:00100000:0.0:1788359381.445649:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2402:x1875230420138240:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359381.445727:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138496 00000100:00100000:1.0:1788359381.445734:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138496 00000100:00100000:0.0:1788359381.445749:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2402:x1875230420138240:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359381.445759:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 373 00000100:00100000:1.0:1788359381.445774:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138368 00000100:00100000:1.0:1788359381.445779:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138368 00000100:00100000:1.0:1788359381.445813:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 257 00000100:00100000:1.0:1788359381.445823:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420138496:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359381.445827:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 258 00000100:00100000:0.0:1788359381.445838:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420138368:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359381.445861:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420138496:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 41us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359381.445872:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 257 00000100:00100000:0.0:1788359381.445878:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420138368:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 40us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359381.445886:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 258 00000100:00080000:2.0:1788359381.446027:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359381.446031:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359381.458036:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359381.458083:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359381.458114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359381.458285:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138752 00000100:00100000:1.0:1788359381.458294:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138752 00000100:00100000:1.0:1788359381.458361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138880 00000100:00100000:1.0:1788359381.458365:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138880 00000100:00100000:1.0:1788359381.458391:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 259 00000100:00100000:1.0:1788359381.458401:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420138752:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359381.458551:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420138752:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 151us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359381.458560:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 259 00000100:00100000:1.0:1788359381.458577:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 260 00000100:00100000:1.0:1788359381.458585:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420138880:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359381.458611:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420138880:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359381.458619:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 260 00000100:00100000:3.0:1788359381.458800:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420138624 00000100:00100000:3.0:1788359381.458806:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420138624 00000100:00100000:3.0:1788359381.458852:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:3.0:1788359381.458860:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2401:x1875230420138624:12345-192.168.202.52@tcp:9:kworker.0 00000020:00000080:3.0:1788359381.458882:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae698 00000100:00080000:3.0:1788359381.458890:0:8431:0:(import.c:65:import_set_state_nolock()) ffffa0eaffada800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788359381.458932:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788359381.459069:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+2:2401:x1875230420138624:12345-192.168.202.52@tcp:9:kworker.0 Request processed in 210us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359381.459076:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 27 00010000:00010000:2.0:1788359381.459362:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788359381.459378:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359381.459392:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359381.459395:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359382.205000:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445393280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359382.205076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359382.205195:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393280 00000100:00100000:3.0:1788359382.205204:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393280 00000100:00100000:3.0:1788359382.205272:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788359382.205283:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445393280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359382.205318:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359382.212424:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445393280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7134us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359382.212438:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788359382.212446:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445393280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788359382.396832:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359382.719467:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359382.719577:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359382.719770:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393408 00000100:00100000:0.0:1788359382.719777:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393408 00000100:00100000:0.0:1788359382.719820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788359382.719826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359382.719854:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359382.719907:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359382.719912:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788359382.720050:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359383.421292:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359384.444787:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359384.764778:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359384.764801:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445393664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359384.764816:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359384.764830:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359384.764867:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.764893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.764963:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393664 00000100:00100000:0.0:1788359384.764970:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393664 00000100:00100000:0.0:1788359384.765021:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393536 00000100:00100000:0.0:1788359384.765024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393536 00000100:00080000:2.0:1788359384.765043:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359384.765044:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00080000:2.0:1788359384.765049:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359384.765066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445393664:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359384.765083:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788359384.765095:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359384.765097:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1788359384.765113:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359384.765172:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445393536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.765179:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788359384.765198:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445393664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 143us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359384.765206:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788359384.765230:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb82d80 x1875230445393664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359384.765247:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445393664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359384.765255:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445393536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359384.765598:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445394048:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.765668:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445394560:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765693:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.765714:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445395072:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.765757:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788359384.765762:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445393920:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.765766:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445394176:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.765798:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445393792:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765802:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445394432:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.765821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.765832:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.765839:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445394304:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.765854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.765870:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394048 00000100:00100000:0.0:1788359384.765875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394048 00000100:00100000:1.0:1788359384.765893:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394560 00000100:00100000:1.0:1788359384.765896:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394560 00000100:00100000:0.0:1788359384.765897:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394304 00000100:00100000:0.0:1788359384.765899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394304 00000100:00100000:0.0:1788359384.765912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788359384.765918:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445394048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.765926:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393920 00000100:00100000:1.0:1788359384.765929:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393920 00000100:00100000:1.0:1788359384.765940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394432 00000100:00100000:1.0:1788359384.765942:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394432 00000100:00100000:1.0:1788359384.765955:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394944 00000100:00100000:1.0:1788359384.765957:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394944 00000100:00100000:0.0:1788359384.765967:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445394048:12345-0@lo:400:kworker.0 Request processed in 50us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.765971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788359384.765974:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788359384.765976:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445394560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.765984:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788359384.765989:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.766006:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445394560:12345-0@lo:400:kworker.0 Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359384.766009:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445394304:12345-0@lo:400:kworker.0 Request processed in 21us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.766012:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788359384.766014:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788359384.766023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788359384.766029:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445393920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766033:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445394304:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766039:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445394816:0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.766054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445393920:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.766068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788359384.766075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.766078:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394816 00000100:00100000:1.0:1788359384.766081:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394816 00000100:00100000:1.0:1788359384.766096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788359384.766101:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766110:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788359384.766116:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445394944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.766127:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445394432:12345-0@lo:400:kworker.0 Request processed in 26us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.766133:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788359384.766137:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445394944:12345-0@lo:400:kworker.0 Request processed in 22us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.766142:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788359384.766148:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445394816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359384.766193:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445394816:12345-0@lo:400:kworker.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.766299:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395072 00000100:00100000:2.0:1788359384.766303:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395072 00000100:00100000:0.0:1788359384.766333:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788359384.766334:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788359384.766346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445395072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766352:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.766369:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445394688:0@lo:400:kworker.0 00000100:00100000:2.0:1788359384.766376:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445395072:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.766382:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788359384.766403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394176 00000100:00100000:2.0:1788359384.766406:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394176 00000100:00100000:2.0:1788359384.766422:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788359384.766428:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359384.766456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445394176:12345-0@lo:400:kworker.0 Request processed in 28us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.766462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1788359384.766484:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359384.766487:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359384.766489:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359384.766520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445393792 00000100:00100000:2.0:1788359384.766524:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445393792 00000100:00100000:0.0:1788359384.766525:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.766543:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445395200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359384.766553:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788359384.766559:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445393792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766563:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359384.766587:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445394176:0@lo:400:kworker.0 00000100:00100000:2.0:1788359384.766588:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445393792:12345-0@lo:400:kworker.0 Request processed in 29us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.766593:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788359384.766605:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445394688 00000100:00100000:0.0:1788359384.766608:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445394688 00000100:00100000:2.0:1788359384.766618:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395200 00000100:00100000:2.0:1788359384.766621:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395200 00000100:00100000:0.0:1788359384.766635:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788359384.766641:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445394688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766672:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445394688:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359384.766678:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788359384.766703:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445394688:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766748:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445393920:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766758:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445394432:0@lo:400:kworker.0 00010000:00080000:0.0:1788359384.766768:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb86680 x1875230445394944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359384.766788:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445394944:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766798:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445394048:0@lo:400:kworker.0 00010000:00080000:0.0:1788359384.766807:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb87b80 x1875230445394560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359384.766814:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445394560:0@lo:400:kworker.0 00010000:00080000:0.0:1788359384.766822:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb87100 x1875230445395072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359384.766829:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445395072:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766859:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445393792:0@lo:400:kworker.0 00000100:00100000:0.0:1788359384.766868:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445394816:0@lo:400:kworker.0 00000100:00100000:2.0:1788359384.767021:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788359384.767028:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445395200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359384.767039:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359384.767074:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445395200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359384.767087:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788359384.767102:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359384.767122:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445395200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359384.768213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788359384.768287:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445395328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359384.768327:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359384.768437:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395328 00000100:00100000:1.0:1788359384.768443:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395328 00000100:00100000:1.0:1788359384.768551:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788359384.768561:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445395328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359384.768577:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359384.768611:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445395328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359384.768617:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1788359384.768670:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7525180 x1875230445395328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359384.768685:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445395328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788359385.468983:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359386.492703:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359386.556310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359386.556413:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359386.556446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359386.556470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359386.556512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359386.556539:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139264 00000100:00100000:3.0:1788359386.556548:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139264 00000100:00100000:3.0:1788359386.556600:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139520 00000100:00100000:3.0:1788359386.556603:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139520 00000100:00100000:3.0:1788359386.556620:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139136 00000100:00100000:3.0:1788359386.556622:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139136 00000100:00100000:3.0:1788359386.556634:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139392 00000100:00100000:3.0:1788359386.556636:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139392 00000100:00100000:3.0:1788359386.556672:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 267 00000100:00100000:3.0:1788359386.556682:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420139264:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359386.556753:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420139264:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 74us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359386.556761:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 267 00000100:00100000:3.0:1788359386.556778:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 268 00000100:00100000:3.0:1788359386.556784:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420139520:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359386.556824:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420139520:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359386.556830:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 268 00000100:00100000:3.0:1788359386.556842:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 269 00000100:00100000:3.0:1788359386.556848:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420139136:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359386.556869:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420139136:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 22us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359386.556875:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 269 00000100:00100000:3.0:1788359386.556893:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 270 00000100:00100000:3.0:1788359386.556899:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420139392:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359386.556919:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420139392:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 22us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359386.556926:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 270 00000100:00080000:3.0:1788359386.556972:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359386.556976:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359386.565636:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139008 00000100:00100000:2.0:1788359386.565652:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139008 00000100:00100000:2.0:1788359386.565724:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 375 00000100:00100000:2.0:1788359386.565735:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420139008:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359386.565817:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420139008:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 84us (9517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359386.565824:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 375 00000001:00100000:0.0:1788359386.820443:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:0.0:1788359386.820452:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0eaffadf800/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:2.0:1788359386.820527:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffadf800/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-OST0000 00000020:00000080:2.0:1788359386.820580:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaffada800 for lustre-OST0000 00000100:00100000:1.0:1788359387.326414:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788359387.326443:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445395456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788359387.326554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359387.326625:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395456 00000100:00100000:1.0:1788359387.326639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395456 00000100:00100000:1.0:1788359387.326698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788359387.326708:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445395456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359387.326743:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359387.326790:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445395456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359387.326797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788359387.326844:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445395456:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788359387.517151:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788359387.518476:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788359387.522609:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359387.838745:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359387.838773:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445395584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359387.838850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359387.839110:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395584 00000100:00100000:0.0:1788359387.839133:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395584 00000100:00100000:0.0:1788359387.839180:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788359387.839189:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445395584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359387.839227:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788359387.839277:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445395584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359387.839284:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788359387.839328:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445395584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359388.540751:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359389.569515:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788359389.761013:0:14061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:29:48 (1788359388) 00000100:00100000:0.0:1788359389.885414:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445395712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359389.885491:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359389.885585:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395712 00000100:00100000:0.0:1788359389.885592:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395712 00000100:00100000:0.0:1788359389.885642:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788359389.885651:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445395712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359389.885683:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359389.885723:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445395712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359389.885729:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788359389.885780:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445395712:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788359389.885869:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359389.885876:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359389.885884:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445395840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359389.885909:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.885937:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395840 00000100:00100000:3.0:1788359389.885940:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395840 00000100:00100000:3.0:1788359389.885964:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788359389.885969:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445395840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359389.885984:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359389.886011:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445395840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.886016:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788359389.886029:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788359389.886047:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7524a80 x1875230445395840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359389.886062:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445395840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359389.887371:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445395968:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887418:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887451:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445396480:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887484:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887531:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445396992:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887580:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788359389.887586:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445396096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887623:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445396608:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887644:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887659:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445397120:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887678:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.887709:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445395968 00000100:00100000:3.0:1788359389.887715:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445395968 00000100:00100000:3.0:1788359389.887754:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788359389.887762:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445395968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887805:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445395968:12345-0@lo:400:kworker.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.887812:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788359389.887840:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396480 00000100:00100000:3.0:1788359389.887844:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396480 00000100:00100000:3.0:1788359389.887866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788359389.887872:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445396480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.887905:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445396480:12345-0@lo:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.887911:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788359389.887928:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396992 00000100:00100000:3.0:1788359389.887931:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396992 00000100:00100000:3.0:1788359389.887969:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396096 00000100:00100000:3.0:1788359389.887971:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396096 00000100:00100000:3.0:1788359389.887983:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396608 00000100:00100000:3.0:1788359389.887986:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396608 00000100:00100000:3.0:1788359389.887998:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445397120 00000100:00100000:3.0:1788359389.888000:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445397120 00000100:00100000:3.0:1788359389.888013:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788359389.888019:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445396992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888050:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445396992:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888057:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788359389.888070:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788359389.888075:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445396096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888101:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445396096:12345-0@lo:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888120:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788359389.888132:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788359389.888138:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445396608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888163:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445396608:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888169:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788359389.888179:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788359389.888184:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445397120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888207:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445397120:12345-0@lo:400:kworker.0 Request processed in 23us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888212:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788359389.888246:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445396352:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888278:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.888296:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445396864:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888320:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.888342:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788359389.888348:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445396224:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888368:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.888383:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445396736:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.888416:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888437:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.888463:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396864 00000100:00100000:3.0:1788359389.888467:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396864 00000100:00100000:3.0:1788359389.888492:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445397248 00000100:00100000:3.0:1788359389.888514:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445397248 00000100:00100000:3.0:1788359389.888536:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359389.888543:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445396864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888580:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445396864:12345-0@lo:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888585:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788359389.888597:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788359389.888603:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445397248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888629:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445397248:12345-0@lo:400:kworker.0 Request processed in 27us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888634:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788359389.888653:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396352 00000100:00100000:3.0:1788359389.888656:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396352 00000100:00100000:3.0:1788359389.888683:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396736 00000100:00100000:3.0:1788359389.888686:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396736 00000100:00100000:3.0:1788359389.888706:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788359389.888711:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445396352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888739:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445396352:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888745:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788359389.888755:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788359389.888761:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445396736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888784:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445396736:12345-0@lo:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359389.888789:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1788359389.888807:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359389.888811:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359389.888813:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359389.888815:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788359389.888837:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7798000 x1875230445396736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359389.888850:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445396736:0@lo:400:kworker.0 00010000:00080000:3.0:1788359389.888860:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7798700 x1875230445397248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359389.888868:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445397248:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888877:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445396352:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888885:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445396864:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888924:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445396096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888945:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445396608:0@lo:400:kworker.0 00010000:00080000:3.0:1788359389.888954:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c779bb80 x1875230445397120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359389.888963:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445397120:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888972:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445395968:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888982:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445396480:0@lo:400:kworker.0 00000100:00100000:3.0:1788359389.888991:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445396992:0@lo:400:kworker.0 00000100:00100000:0.0:1788359389.889771:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445396224 00000100:00100000:0.0:1788359389.889779:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445396224 00000100:00100000:0.0:1788359389.889814:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788359389.889823:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445396224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359389.889871:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445396224:12345-0@lo:400:kworker.0 Request processed in 50us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359389.889886:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788359389.890098:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359389.890124:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445397504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359389.890174:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359389.890205:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445397504 00000100:00100000:0.0:1788359389.890209:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445397504 00000100:00100000:0.0:1788359389.890234:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788359389.890240:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445397504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359389.890256:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359389.890289:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445397504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359389.890295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1788359389.890339:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb81880 x1875230445397504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359389.890356:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445397504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359389.892156:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445397376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359389.892212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359389.892258:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445396224:0@lo:400:kworker.0 00000100:00100000:2.0:1788359389.892332:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445397376 00000100:00100000:2.0:1788359389.892339:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445397376 00000100:00100000:2.0:1788359389.892387:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788359389.892396:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445397376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359389.892416:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359389.892459:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445397376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359389.892466:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788359389.892584:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445397376:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788359390.591673:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359391.023590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.023677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139648 00000100:00100000:3.0:1788359391.023687:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139648 00000100:00100000:3.0:1788359391.023761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:3.0:1788359391.023771:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:11099:x1875230420139648:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359391.023790:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359391.023813:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae778 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e53 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.023880:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.023893:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.023918:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359391.023965:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359391.023969:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359391.024446:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.024474:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae778 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e53 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.025211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e53 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.025223:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359391.025226:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359391.025230:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359391.025303:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:11099:x1875230420139648:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1533us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359391.025311:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00080000:0.0:1788359391.025972:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359391.038681:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.038789:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139776 00000100:00100000:3.0:1788359391.038799:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139776 00000100:00100000:3.0:1788359391.038953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:3.0:1788359391.038964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:11100:x1875230420139776:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359391.038997:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359391.039019:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae786 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e5a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040790:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040806:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040820:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040835:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040843:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.040850:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041068:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041078:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041085:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359391.041138:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359391.041142:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359391.041471:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041517:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041524:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041532:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041539:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359391.041543:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041551:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041563:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359391.041566:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359391.041571:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041577:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feae78d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041591:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041668:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041674:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041685:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359391.041689:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041695:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041704:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0eacc5ac900) 00010000:00010000:3.0:1788359391.041707:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359391.041710:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041716:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feae794 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041753:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae786 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e5a expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041767:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e5a expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.041776:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359391.041779:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359391.041781:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6e00, rc 0) 00000100:00100000:3.0:1788359391.041859:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11100:x1875230420139776:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 2896us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359391.041939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:1.0:1788359391.046891:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359391.047144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420139904 00000100:00100000:2.0:1788359391.047155:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420139904 00000100:00100000:2.0:1788359391.047275:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:2.0:1788359391.047285:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11100:x1875230420139904:12345-192.168.202.52@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788359391.047381:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11100:x1875230420139904:12345-192.168.202.52@tcp:900:lhsmtool_posix.0 Request processed in 98us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.047389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359391.049720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.049783:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140160 00000100:00100000:3.0:1788359391.049801:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140160 00000100:00100000:3.0:1788359391.049850:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:3.0:1788359391.049859:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11100:x1875230420140160:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359391.049885:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359391.049904:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae7a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e61 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.049979:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.049993:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050003:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050041:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050049:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050056:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050167:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7a00/0x49dd053b5feae7b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050175:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7a00/0x49dd053b5feae7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050182:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7a00/0x49dd053b5feae7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359391.050197:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788359391.050272:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050279:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050286:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050291:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359391.050295:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050301:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050312:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:3.0:1788359391.050315:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359391.050319:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050324:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050336:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050342:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050367:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050372:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359391.050375:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050382:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050389:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0eacc5ac600) 00010000:00010000:3.0:1788359391.050391:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359391.050394:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.050399:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.051141:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae7a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e61 expref: 10 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.051157:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7a00/0x49dd053b5feae7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e61 expref: 9 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359391.051164:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359391.051166:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359391.051169:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7a00, rc 0) 00000100:00100000:3.0:1788359391.051226:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11100:x1875230420140160:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1368us (1515us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788359391.051241:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:3.0:1788359391.054451:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359391.056305:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140288 00000100:00100000:1.0:1788359391.056319:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140288 00000100:00100000:1.0:1788359391.056403:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:1.0:1788359391.056413:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11100:x1875230420140288:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788359391.056615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11100:x1875230420140288:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 203us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359391.056624:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:2.0:1788359391.069286:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.069479:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140416 00000100:00100000:3.0:1788359391.069487:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140416 00000100:00080000:0.0:1788359391.069659:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359391.069777:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:2.0:1788359391.069785:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:11100:x1875230420140416:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788359391.070473:0:6515:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 648us 00000100:00100000:2.0:1788359391.094130:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:11100:x1875230420140416:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 24334us (24842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.094145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 44 00000040:00080000:0.0:1788359391.614468:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788359391.615440:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788359391.616475:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359391.681105:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.681169:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140544 00000100:00100000:2.0:1788359391.681174:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.681180:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140544 00000100:00100000:2.0:1788359391.681204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359391.681223:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359391.681235:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 377 00000100:00100000:3.0:1788359391.681245:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420140544:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359391.681246:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359391.681269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140800 00000100:00100000:2.0:1788359391.681272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140800 00000100:00100000:2.0:1788359391.681369:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141056 00000100:00100000:2.0:1788359391.681373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141056 00000100:00100000:2.0:1788359391.681398:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140672 00000100:00100000:2.0:1788359391.681401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140672 00000100:00100000:2.0:1788359391.681412:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420140928 00000100:00100000:2.0:1788359391.681414:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420140928 00000100:00100000:2.0:1788359391.681429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 277 00000100:00100000:2.0:1788359391.681448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420140800:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359391.681534:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420140544:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 289us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.681534:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420140800:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 84us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359391.681542:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 377 00000100:00100000:2.0:1788359391.681542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 277 00000100:00100000:2.0:1788359391.681560:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 278 00000100:00100000:2.0:1788359391.681565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420141056:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359391.681589:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420141056:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.681595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 278 00000100:00100000:2.0:1788359391.681607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 279 00000100:00100000:2.0:1788359391.681613:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2403:x1875230420140672:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359391.681638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2403:x1875230420140672:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 26us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.681645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 279 00000100:00100000:2.0:1788359391.681656:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 280 00000100:00100000:2.0:1788359391.681660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420140928:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359391.681690:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420140928:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359391.681694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 280 00000100:00080000:2.0:1788359391.681713:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359391.681716:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359392.447538:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445397632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359392.447649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359392.447684:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445397632 00000100:00100000:2.0:1788359392.447691:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445397632 00000100:00100000:2.0:1788359392.447739:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788359392.447754:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445397632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359392.447787:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788359392.447847:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445397632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.447854:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788359392.448140:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445397632:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359392.638779:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359392.721696:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359392.721754:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141184 00000100:00100000:3.0:1788359392.721766:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141184 00000100:00100000:3.0:1788359392.721822:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:3.0:1788359392.721833:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11143:x1875230420141184:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359392.721854:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359392.721874:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae7c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e68 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.721944:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.721959:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.721973:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722002:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722010:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722018:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722065:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722072:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722089:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722096:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359392.722100:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722109:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722121:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359392.722124:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359392.722129:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722136:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae7cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722153:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722159:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722165:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722171:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359392.722173:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722180:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722188:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0ead279ff00) 00010000:00010000:3.0:1788359392.722191:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359392.722194:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722199:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae7d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722229:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae7c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e68 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722239:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:3.0:1788359392.722241:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359392.722250:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae7c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e68 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.722259:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6c00, rc 0) 00000100:00100000:3.0:1788359392.722335:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11143:x1875230420141184:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 504us (657us total) trans 0 rc 301/301 00000100:00100000:3.0:1788359392.722342:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:0.0:1788359392.735853:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359392.735950:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141440 00000100:00100000:1.0:1788359392.735960:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141440 00000100:00100000:1.0:1788359392.736007:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:1.0:1788359392.736014:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11143:x1875230420141440:12345-192.168.202.52@tcp:36:lfs.0 00010000:00010000:1.0:1788359392.736069:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359392.736107:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feae77f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e53 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736121:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacc5ac800) 00010000:00010000:1.0:1788359392.736130:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359392.736180:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736190:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736197:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736212:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736216:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736220:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736657:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736664:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736669:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359392.736680:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4f3a38e reply state 0000000091a6e00e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736697:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736701:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359392.736703:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359392.736704:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788359392.736708:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788359392.736713:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.736717:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737880:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737884:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359392.737888:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737894:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737902:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359392.737904:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359392.737906:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737910:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae7da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359392.737925:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4f3a38e reply state 0000000091a6e00e transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737931:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.737935:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0eac5324700) 00010000:00010000:1.0:1788359392.737937:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359392.737938:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788359392.738028:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+10:11143:x1875230420141440:12345-192.168.202.52@tcp:36:lfs.0 Request processed in 2012us (2182us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788359392.738034:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:3.0:1788359392.801073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359392.801222:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141568 00000100:00100000:0.0:1788359392.801244:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141568 00000100:00100000:0.0:1788359392.801354:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:0.0:1788359392.801373:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+10:11151:x1875230420141568:12345-192.168.202.52@tcp:101:lctl.0 00010000:00010000:0.0:1788359392.801400:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359392.801422:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e6f expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801483:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801537:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801548:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359392.801592:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788359392.801595:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359392.801627:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801648:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e6f expref: 12 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801666:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e6f expref: 11 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359392.801675:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:0.0:1788359392.801678:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359392.801681:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14a600, rc 0) 00000100:00100000:2.0:1788359392.802088:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+11:11151:x1875230420141568:12345-192.168.202.52@tcp:101:lctl.0 Request processed in 717us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.802096:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:0.0:1788359392.836907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359392.836978:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141696 00000100:00100000:3.0:1788359392.836986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141696 00000100:00100000:3.0:1788359392.837031:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 48 00000100:00100000:3.0:1788359392.837039:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+11:11157:x1875230420141696:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359392.837055:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359392.837071:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837165:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837180:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837191:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837201:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837208:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837353:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837439:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837448:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.837455:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359392.837491:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788359392.837739:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359392.837853:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837867:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837874:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837880:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837886:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359392.837890:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837897:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837909:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:2.0:1788359392.837912:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359392.837924:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837931:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feae804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837943:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837949:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837955:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837960:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359392.837964:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837970:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837977:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0eac5324700) 00010000:00010000:2.0:1788359392.837979:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359392.837981:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.837986:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feae80b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.838011:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feae7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e76 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.838037:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e76 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.838044:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359392.838047:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788359392.838049:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7000, rc 0) 00000100:00100000:2.0:1788359392.838165:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+12:11157:x1875230420141696:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1125us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.838174:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 48 00000100:00100000:0.0:1788359392.847182:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359392.847411:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420141952 00000100:00100000:1.0:1788359392.847432:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420141952 00000100:00100000:2.0:1788359392.847669:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:2.0:1788359392.847683:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+12:11157:x1875230420141952:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359392.847705:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359392.847727:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feae819 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e7d expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847839:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847856:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847867:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847916:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847939:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.847946:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788359392.848281:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788359392.848688:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848699:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848708:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848745:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848753:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848760:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848766:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359392.848771:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848778:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848799:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359392.848807:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359392.848812:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848818:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae820 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359392.848831:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd4b3c3b reply state 000000006dd206f8 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848842:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848848:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:2.0:1788359392.848850:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359392.848853:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788359392.848883:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feae819 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 15 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848897:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 14 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.848905:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:2.0:1788359392.848907:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359392.848909:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea400, rc 0) 00000100:00100000:2.0:1788359392.848988:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+15:11157:x1875230420141952:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1308us (1814us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788359392.848997:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:3.0:1788359392.854037:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359392.854118:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142080 00000100:00100000:2.0:1788359392.854129:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142080 00000100:00100000:2.0:1788359392.854180:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:2.0:1788359392.854189:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb0095b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420142080:12345-192.168.202.52@tcp:8:bash.0 00010000:00080000:2.0:1788359392.854226:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1788359392.854320:0:8430:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feae83c 00002000:00100000:2.0:1788359392.854330:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10b7ecde-1562-4877-be1f-e5861af40d5e/ffffa0e9c77e6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788359392.854344:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788359392.854413:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788359392.854443:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c77e3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359392.854551:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb0095b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420142080:12345-192.168.202.52@tcp:8:bash.0 Request processed in 361us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.854559:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:0.0:1788359392.859957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359392.860133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142208 00000100:00100000:2.0:1788359392.860146:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142208 00000100:00100000:2.0:1788359392.860432:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:2.0:1788359392.860443:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:0:x1875230420142208:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359392.860463:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359392.860488:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e84 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359392.860546:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359392.860567:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1788359392.860572:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1788359392.860719:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788359392.860752:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.860799:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.860813:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb600, rc 0) 00000100:00100000:2.0:1788359392.860877:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:0:x1875230420142208:12345-192.168.202.52@tcp:101:bash.0 Request processed in 436us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.860884:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:0.0:1788359392.867943:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359392.868001:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142336 00000100:00100000:3.0:1788359392.868011:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142336 00000100:00100000:3.0:1788359392.868069:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:3.0:1788359392.868093:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11157:x1875230420142336:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359392.868112:0:8882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359392.868133:0:8882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e8b expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.868167:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.868176:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359392.868192:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359392.868197:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.868231:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359392.868245:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359392.868258:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445397760:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359392.868656:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead2976540 going to sleep for 11 seconds 00000100:00100000:2.0:1788359392.870933:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7524a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445397760:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359392.870967:0:8882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359392.870988:0:8882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:2.0:1788359392.871111:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:11157:x1875230420142336:12345-192.168.202.52@tcp:101:bash.0 Request processed in 3033us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359392.871130:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:3.0:1788359392.871227:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359392.871693:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142464 00000100:00100000:1.0:1788359392.871702:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142464 00010000:00010000:1.0:1788359392.871734:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359392.872094:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:1.0:1788359392.872105:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2508050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420142464:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359392.872120:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359392.872140:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.872154:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.872178:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a7da18/0x49dd053b5feae843 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e84 expref: 8 pid: 8431 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.872193:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359392.872198:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359392.872206:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.872217:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359392.872270:0:10335:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359392.872285:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10335:1875230445397888:192.168.202.52@tcp:105: 00000100:00100000:1.0:1788359392.875265:0:10335:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a79c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788359392.893426:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359392.895056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142720 00000100:00100000:2.0:1788359392.895073:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142720 00000100:00100000:2.0:1788359392.895160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359392.895172:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:11157:x1875230420142720:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:2.0:1788359392.895532:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11157:x1875230420142720:12345-192.168.202.52@tcp:35:bash.0 Request processed in 362us (2117us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788359392.895541:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:1.0:1788359392.898959:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10335:1875230445397888:192.168.202.52@tcp:105: 00010000:00010000:1.0:1788359392.898993:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359392.899569:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2508050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420142464:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 27464us (28340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359392.899594:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:1.0:1788359392.957306:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359392.957332:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445398016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359392.957402:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359392.957989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445398016 00000100:00100000:0.0:1788359392.957998:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445398016 00000100:00100000:0.0:1788359392.958063:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788359392.958073:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445398016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359392.958127:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788359392.958177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445398016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359392.958196:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788359392.958554:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445398016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359393.007299:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359393.007436:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420142976 00000100:00100000:3.0:1788359393.007444:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420142976 00000100:00100000:3.0:1788359393.007595:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:3.0:1788359393.007606:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11167:x1875230420142976:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359393.007632:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359393.007653:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e92 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359393.007748:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788359393.007857:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae851 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e92 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.007870:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:3.0:1788359393.007873:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359393.007890:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e92 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.007900:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359393.007951:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+17:11167:x1875230420142976:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 348us (661us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788359393.007956:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00080000:2.0:1788359393.008167:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359393.011827:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.011983:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420143232 00000100:00100000:0.0:1788359393.011993:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420143232 00000100:00100000:0.0:1788359393.012047:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:0.0:1788359393.012056:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+17:11167:x1875230420143232:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359393.012409:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:11167:x1875230420143232:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 353us (592us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788359393.012418:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359393.085830:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.086110:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420143360 00000100:00100000:2.0:1788359393.086130:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420143360 00000100:00100000:2.0:1788359393.086195:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:2.0:1788359393.086205:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+18:11173:x1875230420143360:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359393.086231:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359393.086253:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae85f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6e99 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086541:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086557:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086570:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359393.086733:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788359393.086738:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359393.086823:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086915:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae85f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e99 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086935:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e99 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.086943:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359393.086959:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359393.086963:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea800, rc 0) 00000100:00100000:2.0:1788359393.087033:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+19:11173:x1875230420143360:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 828us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.087040:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:1.0:1788359393.093903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.093991:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420143616 00000100:00100000:2.0:1788359393.094001:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420143616 00000100:00100000:2.0:1788359393.094098:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:2.0:1788359393.094108:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+19:11173:x1875230420143616:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359393.094136:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359393.094155:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae86d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ea0 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.094253:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.094268:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.094279:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359393.094289:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788359393.094398:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae86d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea0 expref: 22 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.094416:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea0 expref: 21 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.094442:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:2.0:1788359393.094445:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359393.094448:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eba00, rc 0) 00000100:00100000:2.0:1788359393.094533:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:11173:x1875230420143616:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 426us (689us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788359393.094540:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:3.0:1788359393.098821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.098977:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420143744 00000100:00100000:2.0:1788359393.098987:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420143744 00000100:00100000:2.0:1788359393.099101:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:2.0:1788359393.099111:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:2403:x1875230420143744:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359393.099135:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359393.099159:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea0 expref: 21 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.099178:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:2.0:1788359393.099182:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359393.099236:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+20:2403:x1875230420143744:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 127us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.099243:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:1.0:1788359393.101472:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.101615:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144000 00000100:00100000:0.0:1788359393.101624:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144000 00000100:00100000:0.0:1788359393.101684:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:0.0:1788359393.101693:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11173:x1875230420144000:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359393.101717:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359393.101737:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ea7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.101972:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.101987:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.101999:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359393.102013:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788359393.102148:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea7 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.102169:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea7 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.102178:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:0.0:1788359393.102180:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788359393.102183:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b200, rc 0) 00000100:00100000:0.0:1788359393.102231:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11173:x1875230420144000:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 539us (777us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788359393.102238:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:1.0:1788359393.109038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.109150:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144128 00000100:00100000:0.0:1788359393.109160:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144128 00000100:00100000:0.0:1788359393.109211:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:0.0:1788359393.109221:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420144128:12345-192.168.202.52@tcp:1:lfs.0 00010000:00010000:0.0:1788359393.109265:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.109297:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.109305:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788359393.109309:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788359393.109313:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.109351:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.109365:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 7 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.109381:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875230445398144:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359393.109484:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6881180 going to sleep for 11 seconds 00000100:00100000:0.0:1788359393.112684:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875230445398144:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359393.112713:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.114578:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.115189:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144256 00000100:00100000:2.0:1788359393.115200:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144256 00002000:00100000:2.0:1788359393.115241:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffffa0e9c803fb80 x1875230420144256/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:719/0 lens 504/0 e 0 to 0 dl 1788359404 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359393.115252:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c803fb80 with x1875230420144256 ext(0->12) 00010000:00010000:2.0:1788359393.115261:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 8 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.115291:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 8 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359393.115300:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c803fb80 00000100:00100000:2.0:1788359393.115381:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:2.0:1788359393.115390:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420144256:12345-192.168.202.52@tcp:4:lfs.0 00000001:00100000:0.0:1788359393.121761:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000100:00100000:2.0:1788359393.126132:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420144256:12345-192.168.202.52@tcp:4:lfs.0 Request processed in 10722us (11542us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788359393.126149:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00002000:00100000:2.0:1788359393.126164:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffffa0e9c803fb80 x1875230420144256/t4294967300(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:719/0 lens 504/448 e 0 to 0 dl 1788359404 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359393.126175:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c803fb80 with x1875230420144256 ext(0->12) 00010000:00010000:2.0:1788359393.126186:0:8436:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.126206:0:8436:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359393.126214:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c803fb80 00000100:00100000:3.0:1788359393.131716:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.132568:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144384 00000100:00100000:0.0:1788359393.132578:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144384 00010000:00010000:0.0:1788359393.132630:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.132694:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:0.0:1788359393.132704:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420144384:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359393.132720:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788359393.132737:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788359393.132740:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788359392 00002000:00010000:0.0:1788359393.132742:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788359392 00002000:00010000:0.0:1788359393.132744:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788359392 00002000:00010000:0.0:1788359393.132746:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788359393.132752:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.132766:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.132792:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feae84a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e8b expref: 9 pid: 8882 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.132809:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788359393.132814:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788359393.132819:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.132828:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.132879:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359393.132939:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420144384:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 235us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359393.132946:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 53 00010000:00010000:2.0:1788359393.133064:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133087:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133126:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133134:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133143:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133150:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14b600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359393.133153:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133230:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133243:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.133251:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e681146/0x49dd053b5feae897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359393.133296:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420144128:12345-192.168.202.52@tcp:1:lfs.0 Request processed in 24076us (24266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.133303:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:1.0:1788359393.140031:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359393.143140:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144640 00000100:00100000:3.0:1788359393.143156:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144640 00000100:00100000:3.0:1788359393.143225:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:3.0:1788359393.143234:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11173:x1875230420144640:12345-192.168.202.52@tcp:35:lfs.0 00000004:00010000:3.0:1788359393.143298:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea7 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359393.143556:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788359393.143684:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788359393.143959:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788359393.143990:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.144001:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 26 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.144006:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.144042:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 26 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.144064:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 26 pid: 7748 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359393.144088:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7525880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875230445398272:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359393.144181:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359393.148212:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.148251:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7525880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875230445398272:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359393.148281:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.148446:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144768 00000100:00100000:1.0:1788359393.148455:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144768 00010000:00010000:1.0:1788359393.148673:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 27 pid: 7748 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.148781:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:1.0:1788359393.148792:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+27:2404:x1875230420144768:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359393.148808:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359393.148816:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 27 pid: 7748 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148829:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 27 pid: 7748 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148861:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae82e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e7d expref: 27 pid: 7748 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148878:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:1.0:1788359393.148884:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148895:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148903:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.148928:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359393.148987:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+26:2404:x1875230420144768:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 196us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359393.148995:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 54 00010000:00010000:0.0:1788359393.149102:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.149110:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359393.149225:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788359393.149328:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788359393.149415:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445398400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788359393.149458:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359393.149486:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359393.149581:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445398400 00000100:00100000:2.0:1788359393.149587:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445398400 00000100:00100000:2.0:1788359393.149644:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788359393.149652:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875230445398400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788359393.149721:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1875230445398400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.149728:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1788359393.149822:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359393.149866:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445398400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788359393.149997:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788359393.150034:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445398528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788359393.150060:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359393.150092:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359393.150122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445398528 00000100:00100000:2.0:1788359393.150127:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445398528 00000100:00100000:2.0:1788359393.150158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788359393.150166:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1875230445398528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788359393.150264:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1875230445398528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (202us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788359393.150270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788359393.150310:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eb009f1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445398528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788359393.150351:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788359393.150377:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150387:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150394:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150400:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359393.150404:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150411:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150423:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:0.0:1788359393.150426:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788359393.150430:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.150436:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feae89e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788359393.150536:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788359393.150618:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788359393.150630:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 425121134385ns, next at 426121131650ns, rc = 0 00000001:00080000:0.0:1788359393.150636:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788359393.150657:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eaf6f05a00) 00010000:00010000:0.0:1788359393.150661:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788359393.150673:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae889 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ea7 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.150757:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+29:11173:x1875230420144640:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 7524us (10735us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788359393.150773:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00000020:00080000:0.0:1788359393.150776:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788359393.154300:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.156677:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420144896 00000100:00100000:1.0:1788359393.156706:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420144896 00000100:00100000:1.0:1788359393.156832:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:1.0:1788359393.156843:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+29:11173:x1875230420144896:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359393.156879:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359393.156903:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feae8a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6eae expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.156963:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feae8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eae expref: 30 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.156978:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feae8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eae expref: 30 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.156996:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359393.157000:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788359393.157003:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057000, rc 0) 00000100:00100000:1.0:1788359393.157070:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11173:x1875230420144896:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 229us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359393.157092:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:2.0:1788359393.161002:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.161168:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420145152 00000100:00100000:0.0:1788359393.161178:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420145152 00000100:00100000:0.0:1788359393.161277:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:0.0:1788359393.161288:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d96c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11173:x1875230420145152:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359393.161546:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d96c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+31:11173:x1875230420145152:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 259us (551us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788359393.161554:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:2.0:1788359393.233550:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.236258:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420145408 00000100:00100000:1.0:1788359393.236273:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420145408 00000100:00100000:1.0:1788359393.236349:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:1.0:1788359393.236358:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+31:11183:x1875230420145408:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359393.236384:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359393.236405:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6eb5 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359393.236522:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788359393.236635:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eb5 expref: 33 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.236649:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:1.0:1788359393.236652:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359393.236657:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eb5 expref: 33 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.236670:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056200, rc 0) 00000100:00100000:1.0:1788359393.236741:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11183:x1875230420145408:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 384us (3201us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788359393.236749:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:3.0:1788359393.240945:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.241222:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420145536 00000100:00100000:1.0:1788359393.241232:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420145536 00000100:00100000:1.0:1788359393.241293:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:1.0:1788359393.241302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11183:x1875230420145536:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:1.0:1788359393.241380:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241398:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241410:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241421:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241429:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241449:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241546:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241555:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241563:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359393.241610:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241623:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241630:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241638:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241644:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.241648:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241655:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241668:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359393.241676:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359393.241682:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241689:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241704:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241710:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241716:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241722:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.241725:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241732:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241740:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:1.0:1788359393.241742:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359393.241745:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241751:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241761:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241772:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241778:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241784:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.241787:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241794:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241802:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359393.241804:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359393.241807:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.241813:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.241897:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11183:x1875230420145536:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 590us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359393.241905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:2.0:1788359393.247144:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.248875:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420145792 00000100:00100000:0.0:1788359393.248888:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420145792 00000100:00100000:0.0:1788359393.248954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:0.0:1788359393.248965:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11183:x1875230420145792:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359393.249206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+33:11183:x1875230420145792:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 243us (2071us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788359393.249214:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359393.292175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.293094:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420146048 00000100:00100000:1.0:1788359393.293107:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420146048 00000100:00100000:1.0:1788359393.293177:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:1.0:1788359393.293188:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+33:11186:x1875230420146048:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359393.293212:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359393.293247:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ebc expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293328:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293343:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293353:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293363:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293370:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293377:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293477:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293485:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293537:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359393.293549:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788359393.293630:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293648:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293654:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293660:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.293663:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293670:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293681:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359393.293683:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359393.293688:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293693:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feae8d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293705:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293711:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293716:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293721:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.293729:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293736:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293743:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:1.0:1788359393.293746:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359393.293749:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293754:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feae8dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293789:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feae8cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 36 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293802:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 35 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.293809:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359393.293812:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788359393.293814:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057a00, rc 0) 00000100:00100000:1.0:1788359393.293871:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11186:x1875230420146048:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 685us (1704us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788359393.293877:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:3.0:1788359393.302295:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.303102:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420146176 00000100:00100000:1.0:1788359393.303113:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420146176 00000100:00100000:1.0:1788359393.303180:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:1.0:1788359393.303191:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11186:x1875230420146176:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:1.0:1788359393.303273:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303290:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303300:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303335:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303342:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303349:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303355:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359393.303360:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303368:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303379:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359393.303381:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359393.303386:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359393.303392:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feae8f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.303483:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11186:x1875230420146176:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 294us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359393.303491:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:2.0:1788359393.310164:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.310282:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420146432 00000100:00100000:0.0:1788359393.310292:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420146432 00000100:00100000:0.0:1788359393.310349:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:0.0:1788359393.310359:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11186:x1875230420146432:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359393.310610:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+36:11186:x1875230420146432:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 251us (454us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788359393.310630:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:3.0:1788359393.544872:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.545081:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420146688 00000100:00100000:2.0:1788359393.545092:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420146688 00000100:00100000:2.0:1788359393.545156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:2.0:1788359393.545165:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+36:11217:x1875230420146688:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:2.0:1788359393.545190:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359393.545210:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae8f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ec3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.545339:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae900 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.545354:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.545366:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae900 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359393.545379:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788359393.545528:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae8f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ec3 expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.545545:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae900 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ec3 expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.545554:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.545557:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359393.545561:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb000, rc 0) 00000100:00100000:2.0:1788359393.545629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11217:x1875230420146688:12345-192.168.202.52@tcp:101:cat.0 Request processed in 465us (766us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788359393.545636:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359393.552413:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359393.552456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.552561:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147072 00000100:00100000:0.0:1788359393.552572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147072 00000100:00100000:2.0:1788359393.552594:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420146816 00000100:00100000:2.0:1788359393.552600:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420146816 00000100:00100000:0.0:1788359393.552645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359393.552655:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11217:x1875230420147072:12345-192.168.202.52@tcp:35:cat.0 00000100:00100000:2.0:1788359393.552738:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:2.0:1788359393.552748:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+39:2404:x1875230420146816:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359393.552761:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359393.552796:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae900 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ec3 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.552814:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.552820:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359393.552925:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11217:x1875230420147072:12345-192.168.202.52@tcp:35:cat.0 Request processed in 271us (467us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788359393.552933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:2.0:1788359393.557241:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+38:2404:x1875230420146816:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 1107us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.557256:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:3.0:1788359393.624864:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.625087:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147328 00000100:00100000:0.0:1788359393.625097:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147328 00000100:00100000:0.0:1788359393.625161:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:0.0:1788359393.625170:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11223:x1875230420147328:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:0.0:1788359393.625193:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359393.625196:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788359393.625218:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feae866 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e99 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625235:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359393.625240:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359393.625253:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae90e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6eca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625352:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625366:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 38 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625388:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625419:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 38 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.625432:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 38 pid: 10096 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.625446:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445398656:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359393.625582:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359393.630344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.630430:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147456 00000100:00100000:2.0:1788359393.630439:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147456 00010000:00010000:2.0:1788359393.630478:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 39 pid: 10096 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359393.630538:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:2.0:1788359393.630548:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+39:2404:x1875230420147456:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359393.630564:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359393.630571:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 39 pid: 10096 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.630585:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 39 pid: 10096 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.630606:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.630611:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.630620:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.630642:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.630659:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359393.630717:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+39:2404:x1875230420147456:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 170us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.630725:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 55 00010000:00010000:0.0:1788359393.630818:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae8e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ebc expref: 38 pid: 10096 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.630836:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445398656:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359393.630856:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.630866:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.630872:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359393.630889:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788359393.631023:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae90e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 39 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.631053:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.631061:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:0.0:1788359393.631065:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788359393.631067:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaff14b600, rc 0) 00000100:00100000:0.0:1788359393.631105:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11223:x1875230420147328:12345-192.168.202.52@tcp:101:dd.0 Request processed in 5936us (6251us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788359393.631112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:3.0:1788359393.642100:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.642827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147584 00000100:00100000:2.0:1788359393.642841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147584 00000100:00100000:2.0:1788359393.642910:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:2.0:1788359393.642921:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11223:x1875230420147584:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:2.0:1788359393.642945:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359393.642965:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae923 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ed1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.642999:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.643013:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.643025:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.643156:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae923 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.643175:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.643191:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.643194:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359393.643198:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eac00, rc 0) 00000100:00100000:2.0:1788359393.643263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11223:x1875230420147584:12345-192.168.202.52@tcp:101:dd.0 Request processed in 344us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.643270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:1.0:1788359393.654572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359393.654723:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147840 00000100:00100000:2.0:1788359393.654733:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147840 00000100:00100000:2.0:1788359393.654792:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 62 00000100:00100000:2.0:1788359393.654803:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11223:x1875230420147840:12345-192.168.202.52@tcp:36:dd.0 00010000:00010000:2.0:1788359393.655011:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.655030:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.655041:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788359393.655093:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788359393.655115:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008d0d440c reply state 00000000330ee65d transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.655127:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.655135:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.655138:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359393.655154:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359393.655246:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+42:11223:x1875230420147840:12345-192.168.202.52@tcp:36:dd.0 Request processed in 444us (688us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788359393.655254:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 62 00000020:00080000:2.0:1788359393.655258:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788359393.660923:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359393.938332:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359393.938441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420147968 00000100:00100000:0.0:1788359393.938452:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420147968 00000100:00100000:0.0:1788359393.938564:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:0.0:1788359393.938582:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+42:11237:x1875230420147968:12345-192.168.202.52@tcp:101:stat.0 00010000:00010000:0.0:1788359393.938780:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359393.938803:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae938 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ed8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938876:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938890:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938902:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938914:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938935:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.938943:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.939018:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.939029:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.939037:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.939081:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359393.939095:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 43 pid: 6515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359393.939109:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445398784:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359393.939209:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359393.943669:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359393.943910:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420148224 00000100:00100000:1.0:1788359393.943920:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420148224 00000100:00100000:1.0:1788359393.943987:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:1.0:1788359393.943998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+44:6172:x1875230420148224:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788359393.944326:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+45:6172:x1875230420148224:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 330us (669us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788359393.944334:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:0.0:1788359393.944984:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445398784:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359393.945010:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359393.947599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359393.947767:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420148352 00000100:00100000:3.0:1788359393.947778:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420148352 00010000:00010000:3.0:1788359393.947818:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 45 pid: 6515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359393.947863:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:3.0:1788359393.947873:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+45:2405:x1875230420148352:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359393.947887:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359393.947894:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 45 pid: 6515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.947926:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 45 pid: 6515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.947948:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b600/0x49dd053b5feae915 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eca expref: 45 pid: 6515 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.947966:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359393.947972:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.947981:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.947988:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359393.948019:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359393.948081:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+44:2405:x1875230420148352:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 208us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359393.948089:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 56 00010000:00010000:2.0:1788359393.948151:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948159:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359393.948211:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788359393.948216:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359393.948249:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948263:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948272:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948279:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948286:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948292:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359393.948296:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948315:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948325:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359393.948328:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359393.948332:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948338:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae93f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948350:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948357:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948363:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948368:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea5000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359393.948370:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948376:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948382:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:2.0:1788359393.948385:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359393.948388:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948404:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae946 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948437:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14b200/0x49dd053b5feae938 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed8 expref: 44 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948452:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed8 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359393.948460:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359393.948462:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359393.948465:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:2.0:1788359393.948489:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+43:11237:x1875230420147968:12345-192.168.202.52@tcp:101:stat.0 Request processed in 9910us (10169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359393.948559:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:3.0:1788359394.027171:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.027282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420148608 00000100:00100000:2.0:1788359394.027293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420148608 00000100:00100000:2.0:1788359394.027359:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:2.0:1788359394.027369:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+43:11243:x1875230420148608:12345-192.168.202.52@tcp:36:truncate.0 00010000:00010000:2.0:1788359394.027427:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359394.027457:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae94d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed8 expref: 43 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.027481:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.027486:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359394.027754:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.027779:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.027790:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788359394.027836:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788359394.027857:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089799015 reply state 0000000070983803 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.027869:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.027875:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.027878:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359394.027880:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359394.027986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+45:11243:x1875230420148608:12345-192.168.202.52@tcp:36:truncate.0 Request processed in 618us (825us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788359394.027993:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 64 00000020:00080000:2.0:1788359394.027997:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788359394.172570:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.172905:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420148736 00000100:00100000:2.0:1788359394.172914:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420148736 00000100:00100000:2.0:1788359394.172991:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:2.0:1788359394.172999:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+45:11257:x1875230420148736:12345-192.168.202.52@tcp:101:stat.0 00010000:00010000:2.0:1788359394.173020:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359394.173043:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae95b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6edf expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173129:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173143:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173153:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173160:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173165:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173168:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173223:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173228:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173232:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359394.173264:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788359394.173267:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359394.173281:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173290:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173303:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173307:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173311:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173315:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.173317:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173321:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173329:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359394.173331:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.173334:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173338:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feae962 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173350:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173356:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173362:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173372:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eaa00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.173376:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173382:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173390:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:2.0:1788359394.173393:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.173395:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173399:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173418:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae95b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 47 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173427:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 46 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.173431:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.173433:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359394.173434:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eba00, rc 0) 00000100:00100000:2.0:1788359394.173491:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+46:11257:x1875230420148736:12345-192.168.202.52@tcp:101:stat.0 Request processed in 492us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359394.173547:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:0.0:1788359394.252874:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.252970:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420148992 00000100:00100000:2.0:1788359394.252985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420148992 00000100:00100000:2.0:1788359394.253048:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:2.0:1788359394.253058:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+46:11267:x1875230420148992:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359394.253111:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359394.253133:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ee6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359394.253235:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788359394.253371:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae977 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ee6 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.253387:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:2.0:1788359394.253390:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359394.253396:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ee6 expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.253411:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb400, rc 0) 00000100:00100000:2.0:1788359394.253488:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+47:11267:x1875230420148992:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 431us (623us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788359394.254699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:3.0:1788359394.260870:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359394.261080:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420149248 00000100:00100000:1.0:1788359394.261091:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420149248 00000100:00100000:1.0:1788359394.261153:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:1.0:1788359394.261162:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+47:11267:x1875230420149248:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:1.0:1788359394.261488:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+48:11267:x1875230420149248:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 326us (625us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788359394.261711:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:1.0:1788359394.336232:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.336383:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420149504 00000100:00100000:2.0:1788359394.336394:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420149504 00000100:00100000:2.0:1788359394.336453:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:2.0:1788359394.336463:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+48:11273:x1875230420149504:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359394.336486:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359394.336548:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae985 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6eed expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.336731:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.336747:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 49 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.336756:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.336787:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 49 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.336800:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 49 pid: 7748 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359394.336814:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445398912:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359394.336948:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359394.339307:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445398912:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359394.339337:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359394.341618:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.346114:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420149632 00000100:00100000:2.0:1788359394.347936:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420149632 00010000:00010000:2.0:1788359394.347988:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 50 pid: 7748 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359394.348021:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:2.0:1788359394.348045:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+50:2404:x1875230420149632:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359394.348074:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359394.348083:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 50 pid: 7748 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348097:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 50 pid: 7748 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348120:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae970 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6edf expref: 50 pid: 7748 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348637:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.348642:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348654:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348662:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.348697:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359394.348798:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.348810:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359394.348825:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788359394.348951:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feae985 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 51 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.348961:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 50 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.348967:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359394.348969:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788359394.348970:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eaa00, rc 0) 00000100:00100000:1.0:1788359394.349016:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+50:11273:x1875230420149504:12345-192.168.202.52@tcp:101:bash.0 Request processed in 12556us (12795us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788359394.349021:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:2.0:1788359394.349663:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+49:2404:x1875230420149632:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 1617us (8050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359394.349672:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:1.0:1788359394.355408:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.355457:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420149888 00000100:00100000:2.0:1788359394.355467:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420149888 00000100:00100000:2.0:1788359394.355668:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:2.0:1788359394.355679:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+49:11273:x1875230420149888:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:2.0:1788359394.355909:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.355928:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.355940:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788359394.355976:0:7748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788359394.355994:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e98d9b7b reply state 00000000c630b9c5 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.356005:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.356012:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.356015:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359394.356020:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359394.356215:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+52:11273:x1875230420149888:12345-192.168.202.52@tcp:36:bash.0 Request processed in 537us (812us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788359394.360182:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 68 00000020:00080000:2.0:1788359394.360193:0:7748:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788359394.361678:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359394.361746:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420150016 00000100:00100000:0.0:1788359394.361754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420150016 00000100:00100000:0.0:1788359394.361851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:0.0:1788359394.361862:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+52:11273:x1875230420150016:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359394.361886:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359394.361907:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ef4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.362008:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.362019:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 53 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.362024:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.362054:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 53 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.362083:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 53 pid: 10096 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359394.362098:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445399040:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359394.362169:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359394.364974:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359394.365032:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420150144 00000100:00100000:3.0:1788359394.365041:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420150144 00010000:00010000:3.0:1788359394.365092:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 54 pid: 10096 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359394.365122:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445399040:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359394.365132:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00010000:00010000:0.0:1788359394.365146:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359394.365316:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+54:2405:x1875230420150144:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359394.365331:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359394.365339:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 54 pid: 10096 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365353:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 54 pid: 10096 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365372:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feae98c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eed expref: 54 pid: 10096 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365444:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359394.365450:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365536:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365603:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.365632:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359394.365686:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+53:2405:x1875230420150144:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 373us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359394.365693:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00010000:00010000:0.0:1788359394.365734:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.365742:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359394.365794:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788359394.365798:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359394.365820:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.365848:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ef4 expref: 53 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.365866:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ef4 expref: 52 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.365873:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:0.0:1788359394.365876:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359394.365879:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359394.365922:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+52:11273:x1875230420150016:12345-192.168.202.52@tcp:101:bash.0 Request processed in 4062us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359394.365928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:1.0:1788359394.369420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.369476:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420150400 00000100:00100000:2.0:1788359394.369485:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420150400 00000100:00100000:2.0:1788359394.369575:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:2.0:1788359394.369585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d95050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+52:11273:x1875230420150400:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:2.0:1788359394.369805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d95050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11273:x1875230420150400:12345-192.168.202.52@tcp:35:bash.0 Request processed in 221us (395us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788359394.369828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:3.0:1788359394.461683:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359394.462968:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420150656 00000100:00100000:1.0:1788359394.462979:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420150656 00000100:00100000:1.0:1788359394.463333:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:1.0:1788359394.463345:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11283:x1875230420150656:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359394.463525:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359394.463547:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6efb expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359394.463834:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788359394.463935:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6efb expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.463946:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:1.0:1788359394.463949:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359394.463952:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6efb expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.463962:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057a00, rc 0) 00000100:00100000:1.0:1788359394.464319:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11283:x1875230420150656:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 977us (2647us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788359394.464325:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:0.0:1788359394.472810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.472874:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420150784 00000100:00100000:2.0:1788359394.472885:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420150784 00000100:00100000:2.0:1788359394.472947:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 71 00000100:00100000:2.0:1788359394.472968:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11283:x1875230420150784:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:2.0:1788359394.473400:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473419:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473429:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473439:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473450:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473457:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473564:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473573:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473581:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359394.473711:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473725:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473731:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473738:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473744:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.473749:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473756:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473768:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359394.473771:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.473775:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473781:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473797:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473803:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473814:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473819:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eae00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.473822:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473828:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473837:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:2.0:1788359394.473839:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.473842:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473848:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feae9c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473858:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473864:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473869:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473874:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.473876:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473891:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473898:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.473900:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.473903:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.473909:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feae9cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359394.474001:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11283:x1875230420150784:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 1034us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359394.474010:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 71 00000100:00100000:3.0:1788359394.482173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.487556:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420151040 00000100:00100000:2.0:1788359394.487572:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420151040 00000100:00100000:2.0:1788359394.487646:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:2.0:1788359394.487658:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11283:x1875230420151040:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359394.487853:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+55:11283:x1875230420151040:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 199us (5692us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788359394.487859:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:3.0:1788359394.611218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359394.611411:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420151296 00000100:00100000:0.0:1788359394.611423:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420151296 00000100:00100000:0.0:1788359394.611575:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 72 00000100:00100000:0.0:1788359394.611586:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+55:11286:x1875230420151296:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359394.611632:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359394.611665:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae9d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f02 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611740:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611756:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611767:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611779:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611787:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611794:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611901:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feae9e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611910:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feae9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.611918:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feae9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359394.611928:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788359394.612182:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612191:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612198:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612204:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359394.612209:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612216:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612229:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359394.612233:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359394.612238:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612244:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feae9d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612260:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612266:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612272:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612277:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359394.612287:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612293:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612302:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:0.0:1788359394.612305:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359394.612308:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612313:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feae9e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612352:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feae9d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f02 expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612369:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feae9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f02 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.612378:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:0.0:1788359394.612380:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359394.612383:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4a00, rc 0) 00000100:00100000:0.0:1788359394.612491:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+57:11286:x1875230420151296:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 905us (1283us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788359394.612538:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 72 00000100:00100000:0.0:1788359394.625397:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359394.625641:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420151424 00000100:00100000:1.0:1788359394.626074:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420151424 00000100:00100000:1.0:1788359394.626155:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:1.0:1788359394.626166:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+57:11286:x1875230420151424:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:1.0:1788359394.626259:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626278:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626290:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626330:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626345:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626352:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626359:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359394.626363:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626381:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626394:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:1.0:1788359394.626397:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359394.626402:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359394.626408:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feae9f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359394.626540:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+57:11286:x1875230420151424:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 328us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359394.626549:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:3.0:1788359394.626726:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359394.626763:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420151552 00000100:00100000:3.0:1788359394.626767:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420151552 00000100:00100000:3.0:1788359394.626801:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:3.0:1788359394.626808:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+57:2405:x1875230420151552:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359394.626819:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359394.626834:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feae9e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f02 expref: 57 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359394.626849:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359394.626852:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359394.626871:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+56:2405:x1875230420151552:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359394.626878:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:0.0:1788359394.641543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.641918:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420151808 00000100:00100000:2.0:1788359394.641928:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420151808 00000100:00100000:2.0:1788359394.641979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:2.0:1788359394.641989:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+56:11286:x1875230420151808:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359394.642207:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+57:11286:x1875230420151808:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 220us (671us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788359394.642244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00010000:00010000:0.0:1788359394.687480:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359394.747757:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.747827:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152064 00000100:00100000:2.0:1788359394.747838:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152064 00000100:00100000:2.0:1788359394.747898:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00100000:2.0:1788359394.747910:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+57:11304:x1875230420152064:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:2.0:1788359394.747936:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359394.747956:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f09 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.748088:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea03 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.748103:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.748114:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea03 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359394.748126:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788359394.748251:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feae9fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f09 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.748271:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea03 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f09 expref: 59 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.748279:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.748282:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788359394.748286:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea600, rc 0) 00000100:00100000:2.0:1788359394.748368:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11304:x1875230420152064:12345-192.168.202.52@tcp:101:cat.0 Request processed in 459us (619us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788359394.748376:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00100000:1.0:1788359394.776247:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359394.776320:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152192 00000100:00100000:0.0:1788359394.776346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152192 00000100:00100000:0.0:1788359394.776414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 75 00000100:00100000:0.0:1788359394.776425:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11305:x1875230420152192:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359394.776449:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359394.776467:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaea11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f10 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776627:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776641:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776651:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359394.776688:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788359394.776692:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359394.776712:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776748:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaea11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f10 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776770:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f10 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359394.776779:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359394.776782:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359394.776791:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4800, rc 0) 00000100:00100000:0.0:1788359394.776852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11305:x1875230420152192:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 430us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359394.776859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 75 00000100:00100000:1.0:1788359394.780401:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359394.780453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152576 00000100:00100000:0.0:1788359394.780464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152576 00000100:00100000:0.0:1788359394.780543:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:0.0:1788359394.780553:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11305:x1875230420152576:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359394.780829:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11305:x1875230420152576:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 277us (447us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788359394.780837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:1.0:1788359394.785889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.786021:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152704 00000100:00100000:2.0:1788359394.786031:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152704 00000100:00100000:2.0:1788359394.786171:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359394.786182:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11305:x1875230420152704:12345-192.168.202.52@tcp:103:lfs.0 00010000:00010000:2.0:1788359394.786198:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788359394.786220:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feae9a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ef4 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.786244:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f09 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.786257:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feae8a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6eae expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.786267:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.786272:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359394.786335:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11305:x1875230420152704:12345-192.168.202.52@tcp:103:lfs.0 Request processed in 155us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359394.786342:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:1.0:1788359394.797654:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.798773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152832 00000100:00100000:2.0:1788359394.798784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152832 00000100:00100000:2.0:1788359394.798845:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 76 00000100:00100000:2.0:1788359394.798854:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11305:x1875230420152832:12345-192.168.202.52@tcp:58:lfs.0 00010000:00010000:2.0:1788359394.798975:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.798998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.799009:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359394.799251:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359394.799413:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788359394.799801:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788359394.799950:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11305:x1875230420152832:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 1093us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359394.799961:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 76 00000100:00100000:1.0:1788359394.830820:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359394.830992:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420152960 00000100:00100000:2.0:1788359394.831001:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420152960 00000100:00100000:2.0:1788359394.831121:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 77 00000100:00100000:2.0:1788359394.831130:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11307:x1875230420152960:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359394.831148:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359394.831165:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaea26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f17 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831216:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831227:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831235:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831242:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831246:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831264:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831341:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831346:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831351:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359394.831384:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788359394.831387:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359394.831400:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831408:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831415:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831419:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831423:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831426:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eae00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.831429:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831439:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831447:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359394.831450:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.831453:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831457:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaea2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831467:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831470:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831473:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831477:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359394.831478:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831481:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831485:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:2.0:1788359394.831486:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359394.831488:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831552:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaea34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831588:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaea26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831606:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 59 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359394.831611:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359394.831613:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359394.831614:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eaa00, rc 0) 00000100:00100000:2.0:1788359394.831668:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11307:x1875230420152960:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 540us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359394.831675:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 77 00000004:00080000:3.0:1788359395.004959:0:9984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426975459872ns, next at 427975456162ns, rc = 0 00000100:00100000:2.0:1788359395.004994:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445399168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359395.005088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.005436:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399168 00000100:00100000:3.0:1788359395.005444:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399168 00000100:00100000:3.0:1788359395.005559:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788359395.005569:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445399168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359395.005600:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788359395.005650:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445399168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.005659:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788359395.005695:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445399296:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.005708:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445399424:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.005756:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.005775:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445399936:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.005797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.005839:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445400448:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.005865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.005893:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445400960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359395.005921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.005942:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359395.005948:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445400832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359395.005975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.006012:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399424 00000100:00100000:3.0:1788359395.006016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399424 00000100:00100000:3.0:1788359395.006048:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399936 00000100:00100000:3.0:1788359395.006051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399936 00000100:00100000:0.0:1788359395.006109:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445399552:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006142:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006161:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445400064:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006182:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006196:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445400576:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006213:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006221:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445401088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359395.006237:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006252:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788359395.006257:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445399680:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006275:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006292:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445400192:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006311:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788359395.006322:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359395.006324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788359395.006331:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359395.006332:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445400704:0@lo:400:kworker.0 00000100:00100000:2.0:1788359395.006348:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400192 00000100:00100000:2.0:1788359395.006353:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400192 00000100:00100000:0.0:1788359395.006363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359395.006369:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445399808:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.006398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399552 00000100:00100000:1.0:1788359395.006403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.006404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399552 00000100:00100000:1.0:1788359395.006425:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445400320:0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.006449:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.006482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400448 00000100:00100000:3.0:1788359395.006486:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400448 00000100:00100000:1.0:1788359395.006517:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400064 00000100:00100000:1.0:1788359395.006522:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400064 00000100:00100000:3.0:1788359395.006531:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400576 00000100:00100000:3.0:1788359395.006536:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400576 00000100:00100000:1.0:1788359395.006548:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399680 00000100:00100000:1.0:1788359395.006552:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399680 00000100:00100000:3.0:1788359395.006563:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788359395.006573:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445399424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.006578:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788359395.006588:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445399936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.006621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb006b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445399424:12345-0@lo:400:kworker.0 Request processed in 49us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788359395.006634:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445399936:12345-0@lo:400:kworker.0 Request processed in 45us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359395.006641:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788359395.006647:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788359395.006655:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445400448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.006661:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788359395.006670:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445400064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.006689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445400448:12345-0@lo:400:kworker.0 Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788359395.006713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788359395.006719:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445400064:12345-0@lo:400:kworker.0 Request processed in 47us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006725:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445400576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.006730:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788359395.006751:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788359395.006762:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445399680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.006769:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445400576:12345-0@lo:400:kworker.0 Request processed in 46us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006776:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788359395.006803:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445399680:12345-0@lo:400:kworker.0 Request processed in 43us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006807:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400960 00000100:00100000:1.0:1788359395.006812:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788359395.006813:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400960 00000100:00100000:3.0:1788359395.006837:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400832 00000100:00100000:3.0:1788359395.006840:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400832 00000100:00100000:3.0:1788359395.006854:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445401088 00000100:00100000:3.0:1788359395.006857:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445401088 00000100:00100000:3.0:1788359395.006869:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788359395.006874:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445400960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359395.006887:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788359395.006918:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445400960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.006926:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788359395.006928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399808 00000100:00100000:0.0:1788359395.006933:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399808 00000100:00100000:3.0:1788359395.006943:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788359395.006951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445400832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788359395.006970:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359395.006975:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788359395.006986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445399552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007000:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445400832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.007007:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788359395.007020:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788359395.007027:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875230445401088:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359395.007034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445399552:12345-0@lo:400:kworker.0 Request processed in 49us (890us total) trans 0 rc 0/0 00002000:00000024:3.0:1788359395.007037:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359395.007044:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788359395.007077:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1875230445401088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.007080:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788359395.007092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445399808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007104:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788359395.007143:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445399808:12345-0@lo:400:kworker.0 Request processed in 52us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.007151:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788359395.007158:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445400832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359395.007176:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445400960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359395.007191:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445399424:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.007197:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445399168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359395.007203:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445399936:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007216:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445400448:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.007241:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400704 00000100:00100000:0.0:1788359395.007246:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400704 00000100:00100000:3.0:1788359395.007266:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445400320 00000100:00100000:0.0:1788359395.007271:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359395.007272:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445400320 00000100:00100000:0.0:1788359395.007281:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445400192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007299:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359395.007308:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445400704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.007320:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445400192:12345-0@lo:400:kworker.0 Request processed in 39us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.007327:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788359395.007348:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445400704:12345-0@lo:400:kworker.0 Request processed in 40us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.007355:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359395.007363:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445400320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.007396:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445400320:12345-0@lo:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359395.007429:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445399296 00000100:00080000:2.0:1788359395.007431:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359395.007435:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445399296 00000100:00080000:2.0:1788359395.007436:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359395.007441:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359395.007443:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359395.007566:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359395.007727:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445399680:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007738:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445400192:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007746:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445400704:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007755:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445399552:0@lo:400:kworker.0 00000100:00100000:0.0:1788359395.007783:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788359395.007835:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaf6cad500 x1875230445400064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359395.007846:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445400064:0@lo:400:kworker.0 00010000:00080000:3.0:1788359395.007862:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c7596300 x1875230445400576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359395.007878:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445400576:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007894:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445401088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359395.007932:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445399808:0@lo:400:kworker.0 00000100:00100000:3.0:1788359395.007941:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445400320:0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.008566:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788359395.008580:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445399296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359395.008646:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445399296:12345-0@lo:400:kworker.0 Request processed in 70us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359395.008655:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788359395.008680:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c61bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445399296:0@lo:400:kworker.0 00000040:00080000:0.0:1788359395.382094:0:14209:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359395.382105:0:14209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359395.382131:0:14209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788359395.382139:0:14209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788359395.709183:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359395.709523:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788359395.709564:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788359395.709574:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788359395.709899:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445401216:192.168.202.52@tcp:107:hsm_cdtr.0 00010000:00010000:1.0:1788359395.710289:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359395.710805:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359395.720716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.722547:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420153088 00000100:00100000:3.0:1788359395.722582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420153088 00000100:00100000:3.0:1788359395.722715:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:3.0:1788359395.722730:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153088:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788359395.722781:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788359395.722979:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153088:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 252us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.722990:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:1.0:1788359395.727442:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00080000:0.0:1788359395.727474:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359395.727687:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420153216 00000100:00100000:3.0:1788359395.727702:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420153216 00000100:00100000:3.0:1788359395.727787:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 79 00000100:00100000:3.0:1788359395.727800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153216:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 00000100:00100000:2.0:1788359395.727867:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445401216:192.168.202.52@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1788359395.727905:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.727930:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.727946:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.727993:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728002:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728010:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728045:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728070:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728078:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359395.728137:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788359395.728142:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359395.728159:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728173:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728181:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728189:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728207:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.728212:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728221:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728235:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359395.728238:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.728243:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728249:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaea42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728266:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728413:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728420:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728426:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.728429:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728437:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728457:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffffa0ead279fa00) 00010000:00010000:3.0:1788359395.728460:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.728463:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728470:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaea49 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728488:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728548:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728556:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728562:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.728565:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728572:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728580:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.728583:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.728586:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.728593:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.728802:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11319:x1875230420153216:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 Request processed in 1000us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.728813:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 79 00000100:00100000:1.0:1788359395.749580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.753480:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420153472 00000100:00100000:2.0:1788359395.753560:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420153472 00000100:00100000:2.0:1788359395.753664:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 80 00000100:00100000:2.0:1788359395.753678:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11319:x1875230420153472:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359395.753707:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359395.753735:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaea57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f1e expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.753884:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.753904:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.753920:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359395.753936:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788359395.754071:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754080:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754113:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754120:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359395.754125:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754134:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754151:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359395.754154:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359395.754161:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754169:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754248:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaea57 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f1e expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754262:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:2.0:1788359395.754265:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359395.754276:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaea57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f1e expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.754288:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb400, rc 0) 00000100:00100000:2.0:1788359395.754383:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153472:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 708us (4822us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788359395.754401:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 80 00000100:00100000:1.0:1788359395.758988:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.759117:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420153600 00000100:00100000:3.0:1788359395.759132:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420153600 00000100:00100000:3.0:1788359395.759214:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:3.0:1788359395.759226:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153600:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788359395.759279:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788359395.759431:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153600:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 207us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.759440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:1.0:1788359395.764228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.764971:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420153856 00000100:00100000:2.0:1788359395.764989:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420153856 00000100:00100000:2.0:1788359395.765084:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:2.0:1788359395.765225:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420153856:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359395.765256:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359395.765260:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788359395.765295:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaea18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f10 expref: 60 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.765325:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359395.765331:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359395.765347:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaea6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f25 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788359395.765983:0:10096:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788359395.766189:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.766207:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.766220:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.766286:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaea6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f25 expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.766318:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f25 expref: 61 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.766328:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eaf6f05700) 00010000:00010000:2.0:1788359395.766331:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359395.766335:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea400, rc 0) 00000100:00100000:2.0:1788359395.766418:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11319:x1875230420153856:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1198us (2205us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788359395.769187:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:1.0:1788359395.772772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.772869:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154112 00000100:00100000:2.0:1788359395.772885:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154112 00000100:00100000:2.0:1788359395.772971:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 83 00000100:00100000:2.0:1788359395.772984:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11319:x1875230420154112:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359395.773243:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359395.773281:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaea73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f25 expref: 61 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773306:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eaf6f05700) 00010000:00010000:2.0:1788359395.773318:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359395.773348:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773365:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773375:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773400:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773408:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773416:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773474:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773482:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773490:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773631:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359395.773637:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773646:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773655:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359395.773658:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359395.773662:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773668:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaea81 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773685:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773690:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773695:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773698:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359395.773701:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773705:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773710:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa351ce02 (ffffa0eaf6f05200) 00010000:00010000:2.0:1788359395.773712:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359395.773714:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.773718:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaea88 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa351ce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.777323:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420154112:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 4322us (4546us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788359395.777340:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 83 00000100:00100000:0.0:1788359395.785473:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.790545:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154240 00000100:00100000:3.0:1788359395.790979:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154240 00000100:00100000:0.0:1788359395.791295:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 84 00000100:00100000:0.0:1788359395.791309:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11319:x1875230420154240:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359395.791341:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359395.791383:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaea8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f2c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.791432:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.791450:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.791463:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.792433:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaea8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.792485:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.792559:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:0.0:1788359395.792563:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359395.792569:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359395.792671:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11319:x1875230420154240:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1365us (7214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.792680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 84 00000100:00100000:1.0:1788359395.795120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.795320:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154496 00000100:00100000:3.0:1788359395.795335:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154496 00000100:00100000:3.0:1788359395.795414:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 85 00000100:00100000:3.0:1788359395.795427:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11319:x1875230420154496:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.795583:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.795615:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.795652:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788359395.795886:0:10096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788359395.795898:0:10096:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427766401875ns, next at 428766399077ns, rc = 0 00000004:00010000:3.0:1788359395.795966:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000823d00ee reply state 00000000a9ffea3e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.795981:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.795991:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.795994:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788359395.795999:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359395.796928:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11319:x1875230420154496:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 1496us (1815us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788359395.796940:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 85 00000100:00100000:1.0:1788359395.804866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.807340:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154624 00000100:00100000:3.0:1788359395.807362:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154624 00000100:00100000:3.0:1788359395.807560:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 86 00000100:00100000:3.0:1788359395.807573:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11319:x1875230420154624:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.807610:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359395.807641:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f33 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.807721:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 64 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.807764:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 64 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.807790:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.807793:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359395.807797:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359395.807907:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+64:11319:x1875230420154624:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 337us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.807916:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 86 00000100:00100000:0.0:1788359395.814349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.814624:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154752 00000100:00100000:2.0:1788359395.814639:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154752 00000100:00100000:2.0:1788359395.814707:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:2.0:1788359395.814717:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420154752:12345-192.168.202.52@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788359395.814761:0:8430:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:2.0:1788359395.814819:0:8430:0:(genops.c:1406:class_connect()) connect: client 10b7ecde-1562-4877-be1f-e5861af40d5e, cookie 0x49dd053b5feaeaab 00002000:00100000:2.0:1788359395.814835:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10b7ecde-1562-4877-be1f-e5861af40d5e/ffffa0ead2211000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788359395.814850:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788359395.814956:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788359395.814993:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0ead2217000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359395.816144:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2401:x1875230420154752:12345-192.168.202.52@tcp:8:lhsmtool_posix.0 Request processed in 1420us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359395.816158:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:2.0:1788359395.830445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.831040:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420154880 00000100:00100000:3.0:1788359395.831065:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420154880 00000100:00100000:0.0:1788359395.831925:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:0.0:1788359395.831940:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:0:x1875230420154880:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788359395.832825:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788359395.833899:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1788359395.833920:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000100:00100000:0.0:1788359395.834158:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:0:x1875230420154880:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 2215us (3723us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788359395.834172:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:1.0:1788359395.838240:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.838362:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420155136 00000100:00100000:0.0:1788359395.838376:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420155136 00000100:00100000:0.0:1788359395.838546:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:0.0:1788359395.838559:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+64:11319:x1875230420155136:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788359395.838860:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11319:x1875230420155136:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 302us (634us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788359395.838869:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:1.0:1788359395.847216:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.848238:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420155392 00000100:00100000:0.0:1788359395.848273:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420155392 00000100:00100000:0.0:1788359395.848360:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 87 00000100:00100000:0.0:1788359395.848373:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11319:x1875230420155392:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788359395.848647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11319:x1875230420155392:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 276us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.848657:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 87 00000100:00100000:1.0:1788359395.854844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.854964:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420155520 00000100:00100000:3.0:1788359395.854979:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420155520 00000100:00100000:3.0:1788359395.855069:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 88 00000100:00100000:3.0:1788359395.855081:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11319:x1875230420155520:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.855113:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359395.855143:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeab2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f3a expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855390:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855410:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855439:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359395.855555:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359395.855594:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855628:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeab2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f3a expref: 67 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855651:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f3a expref: 66 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.855662:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.855666:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788359395.855670:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7600, rc 0) 00000100:00100000:3.0:1788359395.855866:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11319:x1875230420155520:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 785us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.855874:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 88 00000100:00100000:3.0:1788359395.861276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.861427:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420155648 00000100:00100000:0.0:1788359395.861439:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420155648 00000100:00100000:0.0:1788359395.861552:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:0.0:1788359395.861568:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420155648:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359395.861595:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359395.861629:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f41 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359395.861663:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9832e3, blocks: 0x0 00010000:00010000:0.0:1788359395.861686:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788359395.861691:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359395.861701:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.861718:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 6 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.861733:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea5000, rc 0) 00000100:00100000:0.0:1788359395.861790:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420155648:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 228us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.861814:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:0.0:1788359395.869699:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.869801:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420155904 00000100:00100000:3.0:1788359395.869814:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420155904 00000100:00100000:3.0:1788359395.869938:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:3.0:1788359395.869949:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11319:x1875230420155904:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788359395.870115:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11319:x1875230420155904:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 167us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.870122:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:1.0:1788359395.875988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.876096:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156032 00000100:00100000:0.0:1788359395.876110:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156032 00000100:00100000:0.0:1788359395.876187:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:0.0:1788359395.876201:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:11319:x1875230420156032:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359395.876227:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359395.876253:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f48 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.876534:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.876611:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359395.876618:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359395.876625:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.876676:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359395.876695:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359395.876712:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445401344:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359395.876900:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359395.883008:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359395.883261:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445401344:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359395.883319:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.883349:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4800, rc 0) 00000100:00100000:1.0:1788359395.883432:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c62e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11319:x1875230420156032:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 7234us (7458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359395.883443:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:3.0:1788359395.883756:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156160 00000100:00100000:3.0:1788359395.883766:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156160 00010000:00010000:3.0:1788359395.883807:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.883839:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359395.883849:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420156160:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359395.883867:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359395.883896:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.883911:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.883938:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7805c97/0x49dd053b5feaeac0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f41 expref: 7 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.883957:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359395.883962:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359395.883972:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.883983:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.884020:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.884046:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445401472:192.168.202.52@tcp:105: 00000100:00100000:3.0:1788359395.884127:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359395.898923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359395.899128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156288 00000100:00100000:1.0:1788359395.899138:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156288 00000100:00100000:3.0:1788359395.899145:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445401472:192.168.202.52@tcp:105: 00002000:00100000:1.0:1788359395.899202:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffffa0eaffb84e00 x1875230420156288/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:721/0 lens 504/0 e 0 to 0 dl 1788359406 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359395.899214:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffb84e00 with x1875230420156288 ext(0->8) 00002000:00010000:1.0:1788359395.899220:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffb84e00 00000100:00100000:1.0:1788359395.899275:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:1.0:1788359395.899292:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420156288:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.899439:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359395.899608:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420156160:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 15757us (16612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359395.899620:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:1.0:1788359395.901193:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420156288:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 Request processed in 1740us (2122us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788359395.901206:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00002000:00100000:1.0:1788359395.901221:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffffa0eaffb84e00 x1875230420156288/t4294967303(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:721/0 lens 504/448 e 0 to 0 dl 1788359406 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359395.901231:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffb84e00 with x1875230420156288 ext(0->8) 00002000:00010000:1.0:1788359395.901239:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffb84e00 00000100:00100000:2.0:1788359395.906539:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.910213:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156416 00000100:00100000:0.0:1788359395.910238:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156416 00000100:00100000:0.0:1788359395.910412:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 90 00000100:00100000:0.0:1788359395.910429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11319:x1875230420156416:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788359395.916188:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788359395.916220:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788359395.916250:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788359395.916331:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788359395.916345:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0e9c603a780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788359395.916351:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c63d9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c603a480 00000020:00080000:1.0:1788359395.916354:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c63d9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0eac9181e00 00000100:00100000:2.0:1788359395.916767:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359395.916796:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445401600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788359395.917084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359395.917152:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445401600 00000100:00100000:2.0:1788359395.917161:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445401600 00000100:00100000:2.0:1788359395.917222:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788359395.917233:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445401600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788359395.917272:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788359395.917314:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9832e0, atime: 0x6a9832e0, ctime: 0x6a9832e0, blocks: 0x8 00010000:00010000:2.0:1788359395.917325:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.917366:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1788359395.917372:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359395.917382:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.917401:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.917413:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.917421:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.917443:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788359395.917787:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788359395.917983:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788359395.918001:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445401728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788359395.918088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359395.918139:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445401728 00000100:00100000:0.0:1788359395.918144:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445401728 00000100:00100000:0.0:1788359395.918179:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788359395.918187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445401728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788359395.918296:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788359395.918300:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788359395 00002000:00010000:0.0:1788359395.918302:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788359395.918305:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788359395 -> 1788359395 00002000:00010000:0.0:1788359395.918307:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788359395.918352:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445401728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (262us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788359395.918360:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788359395.918411:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffb8e680/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788359395.918418:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445401728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788359395.918569:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11319:x1875230420156416:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 Request processed in 8145us (15075us total) trans 0 rc 0/0 00010000:00010000:3.0:1788359395.918867:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918879:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918888:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918895:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.918901:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918911:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918930:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0eac5324700) 00010000:00010000:3.0:1788359395.918934:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.918940:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918947:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feae7e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918988:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.918995:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919000:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919005:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919008:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919014:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919024:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359395.919026:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.919029:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919034:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feae7e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919061:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919068:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919074:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919086:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919090:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919096:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919104:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05100) 00010000:00010000:3.0:1788359395.919106:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.919108:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919114:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feae827 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919131:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919137:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919143:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919149:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919151:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919157:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919176:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.919178:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.919182:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919187:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feae931 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919199:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919205:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919210:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919216:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919219:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919226:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919234:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.919236:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.919239:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919245:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feae954 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919269:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919275:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919281:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919286:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919289:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919296:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919304:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.919307:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.919309:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919314:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feae99a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919326:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919332:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919339:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919350:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.919353:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919360:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919370:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.919372:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788359395.919375:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.919380:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaea9d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.923248:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445401600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6003us (6150us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788359395.923265:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1788359395.923354:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffb87b80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788359395.923362:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445401600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788359395.923666:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 90 00010000:00010000:3.0:1788359395.923908:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359395.923922:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.923937:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eae00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359395.923942:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.923956:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.923989:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.924020:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb647958/0x49dd053b5feaeace lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.924064:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359395.924066:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359395.924068:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359395.924415:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.924528:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156544 00000100:00100000:0.0:1788359395.924539:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156544 00000100:00100000:0.0:1788359395.924758:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:0.0:1788359395.924768:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2403:x1875230420156544:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788359395.926312:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788359395.926327:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788359395.926703:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420156544:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 Request processed in 1931us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.926715:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:1.0:1788359395.929935:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.930228:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156800 00000100:00100000:2.0:1788359395.930243:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156800 00000100:00100000:2.0:1788359395.930319:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 91 00000100:00100000:2.0:1788359395.930331:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+14:11319:x1875230420156800:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359395.930426:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359395.930462:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeab9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f3a expref: 14 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.930485:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:2.0:1788359395.930491:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359395.930613:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.930632:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.930645:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359395.930821:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009772784 reply state 00000000cd3cd2d4 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.930836:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.930843:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:2.0:1788359395.930846:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359395.930849:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359395.930976:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+15:11319:x1875230420156800:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 646us (1055us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788359395.930984:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 91 00000100:00100000:2.0:1788359395.939076:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359395.939358:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420156928 00000100:00100000:0.0:1788359395.939373:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420156928 00000100:00100000:0.0:1788359395.939452:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:0.0:1788359395.939463:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420156928:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788359395.939736:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788359395.939740:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788359395 -> 1788359394 00002000:00010000:0.0:1788359395.939742:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788359392 00002000:00010000:0.0:1788359395.939744:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788359395 -> 1788359394 00002000:00010000:0.0:1788359395.939746:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788359395.939813:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420156928:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 351us (762us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788359395.939822:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:0.0:1788359395.943197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.943360:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157184 00000100:00100000:3.0:1788359395.943375:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157184 00000100:00100000:3.0:1788359395.943455:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00100000:3.0:1788359395.943467:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+15:11319:x1875230420157184:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.943624:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.943646:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.943657:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.943701:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.943718:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 15 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.943755:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445401856:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359395.943861:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359395.945917:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445401856:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359395.945959:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359395.947725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.948121:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157312 00000100:00100000:3.0:1788359395.948135:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157312 00010000:00010000:3.0:1788359395.948190:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 16 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.948302:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:3.0:1788359395.948314:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+16:2403:x1875230420157312:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359395.948333:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359395.948343:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 16 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948359:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 16 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948387:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaea96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f2c expref: 16 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948413:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.948420:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948449:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948458:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.948571:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359395.948652:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:2403:x1875230420157312:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 340us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.948661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 60 00010000:00010000:2.0:1788359395.948973:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.948999:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949066:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949075:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949083:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949090:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359395.949095:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949104:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949117:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:2.0:1788359395.949121:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788359395.949125:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.949131:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaeadc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.949189:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+14:11319:x1875230420157184:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 Request processed in 5723us (6008us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788359395.949198:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00100000:1.0:1788359395.952241:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.952359:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157440 00000100:00100000:2.0:1788359395.952373:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157440 00000100:00100000:2.0:1788359395.952736:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:2.0:1788359395.952750:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420157440:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788359395.952818:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.952846:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.952856:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359395.952861:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359395.952867:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.952915:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.952934:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 7 pid: 8433 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.952952:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8882:1875230445401984:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359395.953114:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c607dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788359395.958802:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8882:1875230445401984:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359395.958845:0:8882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.958953:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359395.959391:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157568 00000100:00100000:1.0:1788359395.959420:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157568 00010000:00010000:1.0:1788359395.959472:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 8 pid: 8433 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359395.959843:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:1.0:1788359395.959861:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420157568:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359395.959882:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359395.959915:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 8 pid: 8433 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.959933:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 8 pid: 8433 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.959963:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80cc274/0x49dd053b5feaeac7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f48 expref: 8 pid: 8433 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.959988:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359395.959993:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359395.960000:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.960012:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.960060:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359395.960137:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420157568:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 280us (1185us total) trans 0 rc 0/0 00010000:00010000:2.0:1788359395.960189:0:8882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960213:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960238:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960246:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960255:0:8882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960263:0:8882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359395.960268:0:8882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960278:0:8882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960296:0:8882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.960303:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a9e130/0x49dd053b5feaeae3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.960374:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420157440:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 Request processed in 7629us (8152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359395.960385:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:0.0:1788359395.963175:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.963277:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157824 00000100:00100000:3.0:1788359395.963293:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157824 00000100:00100000:1.0:1788359395.963436:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:3.0:1788359395.963556:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 93 00000100:00100000:3.0:1788359395.963569:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+14:11319:x1875230420157824:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788359395.963700:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.963723:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.963734:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.963784:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.963819:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 14 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.963839:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402112:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359395.963947:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359395.967104:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402112:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359395.967145:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359395.968040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.968133:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420157952 00000100:00100000:2.0:1788359395.968144:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420157952 00010000:00010000:2.0:1788359395.968198:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 15 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.968250:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 62 00000100:00100000:2.0:1788359395.968261:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2509450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+15:2404:x1875230420157952:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359395.968281:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359395.968291:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 15 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968305:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 15 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968334:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feae92a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ed1 expref: 15 pid: 6517 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968355:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359395.968381:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968392:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968401:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.968437:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359395.968528:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2509450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+14:2404:x1875230420157952:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 268us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359395.968537:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 62 00010000:00010000:3.0:1788359395.969033:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969045:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969305:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969321:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 14 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969331:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969373:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 14 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.969392:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 14 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.969409:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402240:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359395.969528:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359395.973316:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359395.973367:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158080 00000100:00100000:3.0:1788359395.973380:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158080 00010000:00010000:3.0:1788359395.973475:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 15 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.973593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:3.0:1788359395.973605:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:2404:x1875230420158080:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359395.973626:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359395.973635:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 15 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.973651:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 15 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.973680:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.973687:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.973698:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.973707:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.973728:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359395.973793:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:2404:x1875230420158080:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 190us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359395.973802:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 63 00010000:00010000:2.0:1788359395.974446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeaa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f33 expref: 14 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.974468:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402240:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359395.974700:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.974762:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.974768:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359395.974946:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788359395.975109:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788359395.975146:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788359395.975227:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875230445402368:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788359395.975296:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.975340:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359395.975360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445402368 00000100:00100000:0.0:1788359395.975369:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445402368 00000100:00100000:0.0:1788359395.975437:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788359395.975447:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1875230445402368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788359395.975579:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6517:x1875230445402368:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359395.975587:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788359395.975795:0:6517:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788359395.975800:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffb8e680, transno 4294967304 00000100:00100000:3.0:1788359395.975816:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6377800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875230445402368:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788359395.975949:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788359395.975989:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875230445402496:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788359395.976020:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359395.976044:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359395.976069:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445402496 00000100:00100000:0.0:1788359395.976075:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445402496 00000100:00100000:0.0:1788359395.976103:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788359395.976110:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875230445402496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788359395.976218:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6517:x1875230445402496:12345-0@lo:1000:mdt00_002.0 Request processed in 108us (197us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788359395.976225:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788359395.976245:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6517:1875230445402496:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788359395.976279:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976288:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976293:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976297:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.976310:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976317:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976332:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:3.0:1788359395.976335:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359395.976338:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976343:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeaf1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976372:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976376:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976379:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976383:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.976385:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976388:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976392:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.976394:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359395.976400:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976404:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaea1f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976449:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976462:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976469:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976491:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.976735:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 17 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.976746:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402624:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359395.976807:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359395.979225:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.979298:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158208 00000100:00100000:2.0:1788359395.979310:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158208 00010000:00010000:2.0:1788359395.979355:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 18 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.979401:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:2.0:1788359395.979410:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2405:x1875230420158208:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359395.979428:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359395.979435:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 18 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.979457:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 18 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.979484:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:2.0:1788359395.979490:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.979541:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.979556:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.979580:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359395.979641:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2405:x1875230420158208:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 231us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359395.979648:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 64 00010000:00010000:3.0:1788359395.980322:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaea3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f17 expref: 17 pid: 7748 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359395.980345:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445402624:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359395.980370:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980394:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980401:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980416:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980423:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980431:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980438:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.980443:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980451:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980465:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.980467:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359395.980471:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980477:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeaf8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980487:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980713:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980720:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980725:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359395.980728:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980735:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980744:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0eac5324b00) 00010000:00010000:3.0:1788359395.980747:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359395.980750:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359395.980755:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeaea lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359395.981123:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11319:x1875230420157824:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 17555us (17961us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788359395.981134:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 93 00000020:00080000:2.0:1788359395.981140:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788359395.981784:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359395.981791:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359395.981808:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788359395.981815:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788359395.985582:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359395.985738:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158464 00000100:00100000:2.0:1788359395.985754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158464 00000100:00100000:2.0:1788359395.985822:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:2.0:1788359395.985835:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11319:x1875230420158464:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788359395.986218:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788359395.986263:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788359395.986329:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986348:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986362:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986371:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986378:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986384:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359395.986417:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788359395.986562:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:11319:x1875230420158464:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 729us (997us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788359395.986572:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000020:00080000:2.0:1788359395.986578:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788359395.986761:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359395.986769:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.986776:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359395.986781:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.986790:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.986807:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:1.0:1788359395.986810:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788359395.986815:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.986822:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeaff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359395.986837:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359395.986839:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359395.986841:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359396.732959:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359396.799172:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359396.799223:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359396.799257:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158592 00000100:00100000:2.0:1788359396.799260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359396.799273:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158592 00000100:00100000:2.0:1788359396.799302:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359396.799341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 379 00000100:00100000:3.0:1788359396.799356:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420158592:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359396.799356:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359396.799401:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359396.799453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158720 00000100:00100000:1.0:1788359396.799458:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158720 00000100:00100000:1.0:1788359396.799535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158848 00000100:00100000:1.0:1788359396.799550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158848 00000100:00100000:1.0:1788359396.799577:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420159232 00000100:00100000:1.0:1788359396.799580:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420159232 00000100:00100000:1.0:1788359396.799595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 287 00000100:00100000:1.0:1788359396.799601:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2403:x1875230420158720:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359396.799687:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420158592:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 335us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359396.799694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 379 00000100:00100000:2.0:1788359396.801288:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359396.803465:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420158976 00000100:00100000:3.0:1788359396.803491:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420158976 00000100:00100000:3.0:1788359396.803605:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420159104 00000100:00100000:3.0:1788359396.803608:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420159104 00000100:00100000:1.0:1788359396.804580:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2403:x1875230420158720:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 4969us (5347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359396.804593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 287 00000100:00100000:1.0:1788359396.804617:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420159360 00000100:00100000:1.0:1788359396.804621:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420159360 00000100:00100000:1.0:1788359396.804936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 288 00000100:00100000:1.0:1788359396.804943:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420158848:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359396.806605:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 88 00000100:00100000:3.0:1788359396.806622:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420158976:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359396.806792:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420158976:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 175us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359396.806802:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 88 00000100:00100000:3.0:1788359396.806824:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:3.0:1788359396.806833:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2402:x1875230420159104:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359396.806862:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2402:x1875230420159104:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 31us (7463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359396.806868:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:3.0:1788359396.806893:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 289 00000100:00100000:3.0:1788359396.806901:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420159232:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359396.806934:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420159232:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 34us (7597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359396.806941:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 289 00000100:00100000:3.0:1788359396.806972:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 290 00000100:00100000:3.0:1788359396.806982:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2402:x1875230420159360:12345-192.168.202.52@tcp:400:kworker.0 00000100:00080000:2.0:1788359396.806996:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359396.807020:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359396.807026:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359396.807034:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2402:x1875230420159360:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 48us (5750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359396.807053:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 290 00000100:00100000:1.0:1788359396.807372:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2402:x1875230420158848:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 2427us (8071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359396.807380:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 288 00000040:00080000:1.0:1788359397.031956:0:14260:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359397.031967:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359397.032001:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788359397.032008:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788359397.132655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.132772:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420159616 00000100:00100000:3.0:1788359397.132790:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420159616 00000100:00100000:3.0:1788359397.132850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 94 00000100:00100000:3.0:1788359397.132860:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+18:11336:x1875230420159616:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359397.132880:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.132901:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f4f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.133012:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeb0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.133027:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeb0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.133051:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeb0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359397.133062:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788359397.133154:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f4f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.133170:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeb0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f4f expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.133179:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.133181:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788359397.133185:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7800, rc 0) 00000100:00100000:3.0:1788359397.133239:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11336:x1875230420159616:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 381us (594us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788359397.133247:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 94 00000100:00080000:2.0:1788359397.135203:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359397.139754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.139872:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420159744 00000100:00100000:3.0:1788359397.139881:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420159744 00000100:00100000:3.0:1788359397.139938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 95 00000100:00100000:3.0:1788359397.139947:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11336:x1875230420159744:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:3.0:1788359397.140023:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140055:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140067:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140082:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140089:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140095:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140170:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140177:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140184:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359397.140225:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140243:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140249:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140256:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140262:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.140266:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140273:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140285:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.140287:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.140292:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140298:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140307:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140314:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140319:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140329:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.140333:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140338:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140346:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0ead279f800) 00010000:00010000:3.0:1788359397.140348:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.140351:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140357:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140369:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140438:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140446:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140450:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.140453:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140459:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140477:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.140479:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.140482:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.140488:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.140772:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11336:x1875230420159744:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 823us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.140780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 95 00000100:00100000:3.0:1788359397.195386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.195445:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160000 00000100:00100000:1.0:1788359397.195456:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160000 00000100:00100000:3.0:1788359397.195525:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 96 00000100:00100000:3.0:1788359397.195546:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11339:x1875230420160000:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359397.195569:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.195591:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f56 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195667:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195681:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195692:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195708:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195729:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195736:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195868:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195877:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195897:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359397.195908:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788359397.195985:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195992:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.195998:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196004:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.196009:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196016:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196049:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.196052:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.196057:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196063:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196078:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196083:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196089:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196093:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.196095:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196101:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196108:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0ead279f700) 00010000:00010000:3.0:1788359397.196110:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.196113:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196120:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196169:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196183:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.196190:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.196193:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359397.196195:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359397.196259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11339:x1875230420160000:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 725us (879us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788359397.196266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 96 00000100:00100000:1.0:1788359397.206816:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.207653:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160128 00000100:00100000:3.0:1788359397.207665:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160128 00000100:00100000:3.0:1788359397.207734:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:3.0:1788359397.207744:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11339:x1875230420160128:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:3.0:1788359397.207820:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207838:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207851:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207888:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207915:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207922:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207929:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.207933:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207942:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207954:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.207957:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359397.207962:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.207968:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.208059:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11339:x1875230420160128:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 316us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.208068:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:1.0:1788359397.210474:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.211168:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160384 00000100:00100000:2.0:1788359397.211179:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160384 00000100:00100000:2.0:1788359397.211239:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:2.0:1788359397.211248:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d97850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11339:x1875230420160384:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359397.211464:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d97850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+23:11339:x1875230420160384:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 216us (996us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788359397.211472:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:0.0:1788359397.240450:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.241174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160640 00000100:00100000:3.0:1788359397.241184:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160640 00000100:00100000:2.0:1788359397.241281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 98 00000100:00100000:2.0:1788359397.241292:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:10858:x1875230420160640:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359397.241316:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359397.241334:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb5a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f5d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.241421:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.241432:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.241438:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.241462:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.241472:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 24 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359397.241507:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445402752:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359397.241598:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359397.242916:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445402752:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359397.242938:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.244299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.244349:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160768 00000100:00100000:1.0:1788359397.244356:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160768 00010000:00010000:1.0:1788359397.244394:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359397.244429:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:1.0:1788359397.244439:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+25:2404:x1875230420160768:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359397.244454:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359397.244461:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244472:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244489:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeb45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f56 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244552:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.244558:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244567:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244575:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.244603:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359397.244959:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.244965:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359397.244983:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:1.0:1788359397.245092:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+25:2404:x1875230420160768:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 653us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359397.245100:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 65 00010000:00010000:2.0:1788359397.245125:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.245144:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.245153:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:2.0:1788359397.245156:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788359397.245158:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb600, rc 0) 00000100:00100000:2.0:1788359397.245183:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+24:10858:x1875230420160640:12345-192.168.202.52@tcp:101:bash.0 Request processed in 3894us (4741us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788359397.245190:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 98 00000100:00100000:1.0:1788359397.247118:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.247179:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420160896 00000100:00100000:3.0:1788359397.247189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420160896 00000100:00100000:3.0:1788359397.247241:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 99 00000100:00100000:3.0:1788359397.247252:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+24:10858:x1875230420160896:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359397.247286:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.247306:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f64 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247338:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247349:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247358:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247444:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaeb6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f64 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247455:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f64 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.247462:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.247464:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359397.247472:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6c00, rc 0) 00000100:00100000:3.0:1788359397.247547:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+25:10858:x1875230420160896:12345-192.168.202.52@tcp:101:bash.0 Request processed in 296us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.247553:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 99 00000100:00100000:3.0:1788359397.250938:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.251077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161152 00000100:00100000:1.0:1788359397.251088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161152 00000100:00100000:1.0:1788359397.251152:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 100 00000100:00100000:1.0:1788359397.251163:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:10858:x1875230420161152:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:1.0:1788359397.251978:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.252000:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.252012:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788359397.252093:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788359397.252127:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cba3104c reply state 00000000cf9bbd61 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.252140:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.252147:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.252150:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359397.252154:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788359397.252239:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788359397.252365:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+29:10858:x1875230420161152:12345-192.168.202.52@tcp:36:bash.0 Request processed in 1201us (1435us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788359397.252373:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 100 00000020:00080000:1.0:1788359397.252378:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788359397.256090:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.256182:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161280 00000100:00100000:2.0:1788359397.256205:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161280 00000100:00100000:2.0:1788359397.256284:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 101 00000100:00100000:2.0:1788359397.256293:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+29:10858:x1875230420161280:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359397.256315:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359397.256334:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f6b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.256390:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f6b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.256405:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f6b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.256425:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:2.0:1788359397.256428:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359397.256432:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea800, rc 0) 00000100:00100000:2.0:1788359397.256535:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:10858:x1875230420161280:12345-192.168.202.52@tcp:101:bash.0 Request processed in 243us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359397.256542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 101 00000100:00100000:0.0:1788359397.261313:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.261386:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161408 00000100:00100000:3.0:1788359397.261397:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161408 00000100:00100000:3.0:1788359397.261472:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:3.0:1788359397.261528:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:10858:x1875230420161408:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359397.261545:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.261571:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f72 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788359397.261594:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9832e2, atime: 0x6a9832e0, ctime: 0x6a9832e2, blocks: 0x8 00010000:00010000:3.0:1788359397.261615:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1788359397.261619:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359397.261635:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.261652:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.261664:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6800, rc 0) 00000100:00100000:3.0:1788359397.261723:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:10858:x1875230420161408:12345-192.168.202.52@tcp:101:bash.0 Request processed in 231us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.261729:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00080000:2.0:1788359397.262076:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359397.265804:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.265933:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161536 00000100:00100000:2.0:1788359397.265943:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161536 00002000:00010000:2.0:1788359397.265987:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788359397.265993:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c74bfb80 with x1875230420161536 ext(0->18446744073709551615) 00002000:00010000:2.0:1788359397.266005:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c74bfb80. 00000100:00100000:2.0:1788359397.266058:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:2.0:1788359397.266075:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420161536:12345-192.168.202.52@tcp:10:bash.0 00002000:00010000:2.0:1788359397.266378:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788359397.266382:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788359394 -> 1788359396 00002000:00010000:2.0:1788359397.266384:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788359392 -> 1788359392 00002000:00010000:2.0:1788359397.266386:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788359394 -> 1788359396 00002000:00010000:2.0:1788359397.266389:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788359397.266463:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420161536:12345-192.168.202.52@tcp:10:bash.0 Request processed in 391us (667us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788359397.266471:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00002000:00010000:2.0:1788359397.266475:0:8436:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788359397.266478:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c74bfb80 with x1875230420161536 ext(0->18446744073709551615) 00002000:00010000:2.0:1788359397.266483:0:8436:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c74bfb80. 00000100:00100000:0.0:1788359397.346155:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.346438:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161664 00000100:00100000:3.0:1788359397.346448:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161664 00000100:00100000:3.0:1788359397.346551:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 102 00000100:00100000:3.0:1788359397.346561:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11353:x1875230420161664:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:3.0:1788359397.347970:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348001:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348010:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348021:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348026:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348030:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348137:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348146:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348152:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359397.348196:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348208:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348214:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348232:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348238:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.348257:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348266:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348279:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.348282:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.348287:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348293:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeb92 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348306:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348312:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348318:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348323:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.348326:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348341:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348348:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0ead279fe00) 00010000:00010000:3.0:1788359397.348351:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.348354:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348359:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaeb99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348374:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348380:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348385:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348390:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.348393:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348398:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348405:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.348407:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.348410:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.348424:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaeba0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.348565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11353:x1875230420161664:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 2002us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.348575:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 102 00000100:00100000:0.0:1788359397.402297:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.402389:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420161920 00000100:00100000:1.0:1788359397.402400:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420161920 00000100:00100000:1.0:1788359397.402558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 103 00000100:00100000:1.0:1788359397.402568:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11356:x1875230420161920:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359397.402598:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359397.402623:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaeba7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f79 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402701:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402717:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402731:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402746:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402753:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402759:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402871:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaebbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402882:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaebbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.402890:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaebbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359397.402913:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788359397.403007:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403015:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403022:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403028:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359397.403043:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403052:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403063:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359397.403067:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359397.403072:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403078:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaebae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403093:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403099:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403114:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403118:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359397.403121:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403127:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403134:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:1.0:1788359397.403136:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359397.403139:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403143:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaebb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403184:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaeba7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f79 expref: 33 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403197:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaebbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f79 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.403204:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.403207:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788359397.403209:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056600, rc 0) 00000100:00100000:1.0:1788359397.403279:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11356:x1875230420161920:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 712us (991us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788359397.403296:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 103 00000100:00100000:1.0:1788359397.407199:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.407339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420162048 00000100:00100000:2.0:1788359397.407350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420162048 00000100:00100000:2.0:1788359397.407412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 104 00000100:00100000:2.0:1788359397.407422:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11356:x1875230420162048:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:2.0:1788359397.407522:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.407539:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.407549:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.407587:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.407622:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 32 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359397.407640:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445402880:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359397.407733:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359397.410019:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445402880:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359397.410060:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.410532:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.410588:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420162304 00000100:00100000:0.0:1788359397.410594:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420162304 00000100:00100000:0.0:1788359397.410638:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:0.0:1788359397.410644:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+33:6173:x1875230420162304:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788359397.410879:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+34:6173:x1875230420162304:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 235us (348us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788359397.410895:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:3.0:1788359397.412681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.412732:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420162432 00000100:00100000:1.0:1788359397.412741:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420162432 00010000:00010000:1.0:1788359397.412775:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 34 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359397.412810:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:1.0:1788359397.412819:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:2404:x1875230420162432:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359397.412830:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359397.412835:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 34 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412845:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 34 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412861:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaeb61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f5d expref: 34 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412872:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.412875:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412882:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412887:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.412920:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359397.412956:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+33:2404:x1875230420162432:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359397.412961:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 66 00010000:00010000:3.0:1788359397.413006:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413011:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413055:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413062:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413069:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413076:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.413080:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413088:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413095:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.413101:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359397.413105:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.413109:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaebca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.413146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11356:x1875230420162048:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 5727us (5957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.413151:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 104 00000100:00100000:0.0:1788359397.416091:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.416187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420162688 00000100:00100000:2.0:1788359397.416197:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420162688 00000100:00100000:2.0:1788359397.416250:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:2.0:1788359397.416259:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+32:11356:x1875230420162688:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359397.416486:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+33:11356:x1875230420162688:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 226us (406us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788359397.416519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:0.0:1788359397.502105:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.502207:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420162944 00000100:00100000:3.0:1788359397.502228:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420162944 00000100:00100000:3.0:1788359397.502291:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:3.0:1788359397.502302:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+33:11367:x1875230420162944:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:3.0:1788359397.502335:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.502372:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaebd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f80 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502455:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502471:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502483:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502537:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502544:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502561:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502662:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaebe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502684:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaebe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502690:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaebe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359397.502697:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788359397.502758:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502763:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502768:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502771:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.502775:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502779:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502788:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.502789:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.502798:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502803:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaebd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502813:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502816:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502822:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502832:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.502835:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502841:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502849:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0ead279fe00) 00010000:00010000:3.0:1788359397.502852:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.502855:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502860:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaebdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502900:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaebd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f80 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502924:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaebe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f80 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.502931:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.502933:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359397.502936:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359397.503008:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11367:x1875230420162944:12345-192.168.202.52@tcp:101:cat.0 Request processed in 701us (905us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788359397.503015:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:0.0:1788359397.508156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.508400:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420163200 00000100:00100000:2.0:1788359397.508411:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420163200 00000100:00100000:2.0:1788359397.508483:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:2.0:1788359397.508513:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11367:x1875230420163200:12345-192.168.202.52@tcp:35:cat.0 00000100:00100000:2.0:1788359397.508846:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+36:11367:x1875230420163200:12345-192.168.202.52@tcp:35:cat.0 Request processed in 354us (698us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788359397.508856:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:0.0:1788359397.531432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.531869:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420163456 00000100:00100000:1.0:1788359397.531878:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420163456 00000100:00100000:1.0:1788359397.531929:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00100000:1.0:1788359397.531936:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+36:11368:x1875230420163456:12345-192.168.202.52@tcp:36:rm.0 00010000:00010000:1.0:1788359397.531988:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788359397.532022:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaeb84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f6b expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532057:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaebe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f80 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532072:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaebbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f79 expref: 34 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532085:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaeb76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f64 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532092:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.532096:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359397.532114:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532123:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532152:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532162:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532167:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532170:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532366:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532373:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532377:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788359397.532610:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788359397.532695:0:6515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429503122203ns, next at 430503120307ns, rc = 0 00010000:00010000:1.0:1788359397.532741:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532747:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532752:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532765:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532769:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532772:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532781:0:6515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359397.532806:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532812:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532818:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532823:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359397.532827:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532833:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532843:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:1.0:1788359397.532845:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788359397.532850:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532865:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaec02 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532878:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532882:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532885:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532888:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359397.532890:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532893:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532898:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359397.532899:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359397.532900:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532903:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaebf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359397.532909:0:6515:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007759d235 reply state 0000000060a359b7 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532916:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.532924:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:1.0:1788359397.532926:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359397.532927:0:6515:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788359397.533080:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+34:11368:x1875230420163456:12345-192.168.202.52@tcp:36:rm.0 Request processed in 1143us (1657us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788359397.533085:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 106 00010000:00010000:3.0:1788359397.533284:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359397.533292:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.533298:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359397.533301:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.533308:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.533317:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:3.0:1788359397.533320:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788359397.533323:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.533329:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaec09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.533339:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359397.533346:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359397.533347:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359397.565921:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445403008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359397.565996:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359397.566132:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445403008 00000100:00100000:1.0:1788359397.566142:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445403008 00000100:00100000:1.0:1788359397.566194:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788359397.566203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445403008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359397.566238:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359397.566941:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445403008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 736us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359397.566950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788359397.567095:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445403008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359397.580789:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.580908:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420163712 00000100:00100000:3.0:1788359397.580918:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420163712 00000100:00100000:3.0:1788359397.580966:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 107 00000100:00100000:3.0:1788359397.580973:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:11374:x1875230420163712:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359397.580994:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.581019:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec10 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f87 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581128:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581143:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581154:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581165:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581172:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581179:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359397.581529:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788359397.581869:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581876:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581881:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581908:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581913:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581917:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581921:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.581923:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581928:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581935:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.581937:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359397.581940:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581951:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359397.581961:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9012323 reply state 000000007b08c645 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581968:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.581972:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:3.0:1788359397.581974:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359397.581976:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788359397.582185:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec10 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.582198:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 36 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.582206:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:3.0:1788359397.582208:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359397.582211:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359397.582276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+37:11374:x1875230420163712:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1302us (1496us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788359397.582281:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 107 00000100:00100000:2.0:1788359397.586243:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.586363:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420163840 00000100:00100000:0.0:1788359397.586373:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420163840 00000100:00100000:0.0:1788359397.586460:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:0.0:1788359397.586470:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2403:x1875230420163840:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359397.586490:0:8882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359397.586554:0:8882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f8e expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359397.586588:0:8882:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359397.586608:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1788359397.586614:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359397.586623:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 8 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.586643:0:8882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 8 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.586657:0:8882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359397.586706:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2403:x1875230420163840:12345-192.168.202.52@tcp:101:bash.0 Request processed in 238us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.586723:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:1.0:1788359397.589482:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.589721:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420163968 00000100:00100000:0.0:1788359397.589729:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420163968 00000100:00100000:0.0:1788359397.589775:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:0.0:1788359397.589785:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:11374:x1875230420163968:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359397.589803:0:8882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359397.589820:0:8882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f95 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.589859:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 9 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.589869:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359397.589874:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359397.589878:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 9 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.589906:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 9 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.589916:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 9 pid: 8882 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.589927:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445403136:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359397.590182:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788359397.593702:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.593783:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420164096 00000100:00100000:2.0:1788359397.593792:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420164096 00010000:00010000:2.0:1788359397.593828:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 10 pid: 8882 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359397.593875:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:2.0:1788359397.593884:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2404:x1875230420164096:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359397.593899:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359397.593918:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 10 pid: 8882 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.593934:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 10 pid: 8882 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.593957:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359397.593961:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359397.593969:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 10 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.593978:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 10 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.594130:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 10 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359397.594146:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875230445403264:192.168.202.52@tcp:105: 00000100:00100000:2.0:1788359397.594232:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788359397.594599:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e547c924/0x49dd053b5feaec33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f8e expref: 10 pid: 8882 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.594617:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445403136:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359397.594643:0:8882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 9 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.594653:0:8882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea5000, rc 0) 00000100:00100000:0.0:1788359397.594686:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+9:11374:x1875230420163968:12345-192.168.202.52@tcp:101:bash.0 Request processed in 4903us (5210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.594693:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:0.0:1788359397.600969:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c6a13800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6502:1875230445403264:192.168.202.52@tcp:105: 00010000:00010000:0.0:1788359397.601006:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359397.601364:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420164096:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 7479us (7669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.601375:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:0.0:1788359397.601479:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.601603:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420164352 00000100:00100000:3.0:1788359397.601610:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420164352 00000100:00100000:3.0:1788359397.601655:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:3.0:1788359397.601664:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+37:11374:x1875230420164352:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:3.0:1788359397.601933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11374:x1875230420164352:12345-192.168.202.52@tcp:35:bash.0 Request processed in 270us (453us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788359397.601940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:0.0:1788359397.707937:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.708124:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420164480 00000100:00100000:3.0:1788359397.708134:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420164480 00000100:00100000:3.0:1788359397.708193:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 108 00000100:00100000:3.0:1788359397.708202:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+38:11390:x1875230420164480:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359397.708229:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.708250:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6f9c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708332:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708346:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708357:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359397.708395:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788359397.708400:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359397.708418:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708440:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f9c expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708457:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f9c expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.708475:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359397.708478:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359397.708481:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:3.0:1788359397.708590:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11390:x1875230420164480:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 389us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.708597:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 108 00000100:00100000:1.0:1788359397.712901:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.717331:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420164736 00000100:00100000:0.0:1788359397.717348:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420164736 00000100:00100000:0.0:1788359397.717432:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 109 00000100:00100000:0.0:1788359397.717444:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+39:11390:x1875230420164736:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359397.717464:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359397.717486:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fa3 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.717650:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaec56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.717667:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaec56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.717680:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaec56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359397.717692:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788359397.717809:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fa3 expref: 42 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.717830:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaec56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fa3 expref: 41 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.717839:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:0.0:1788359397.717841:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359397.717845:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359397.717920:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+41:11390:x1875230420164736:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 478us (5027us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788359397.717928:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 109 00000100:00100000:0.0:1788359397.721017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.721105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420164992 00000100:00100000:2.0:1788359397.721116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420164992 00000100:00100000:2.0:1788359397.721177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 110 00000100:00100000:2.0:1788359397.721186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+41:11390:x1875230420164992:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359397.721211:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359397.721231:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaec64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6faa expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.721335:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.721350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.721362:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359397.721374:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788359397.721469:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaec64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6faa expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.721487:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6faa expref: 43 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.721529:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359397.721541:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788359397.721545:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb000, rc 0) 00000100:00100000:2.0:1788359397.721605:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+43:11390:x1875230420164992:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 419us (1012us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788359397.721626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 110 00000100:00100000:3.0:1788359397.722133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.722589:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165120 00000100:00100000:2.0:1788359397.722597:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165120 00000100:00100000:2.0:1788359397.722636:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:2.0:1788359397.722644:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+43:2402:x1875230420165120:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359397.722655:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359397.722672:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaec56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fa3 expref: 43 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.722688:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359397.722692:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359397.722729:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+42:2402:x1875230420165120:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 86us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359397.722736:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:3.0:1788359397.727663:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.727892:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165248 00000100:00100000:0.0:1788359397.727902:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165248 00000100:00100000:0.0:1788359397.727966:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:0.0:1788359397.727976:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420165248:12345-192.168.202.52@tcp:1:lfs.0 00010000:00010000:0.0:1788359397.728059:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.728080:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.728089:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359397.728094:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788359397.728099:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.728145:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.728161:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 8 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.728178:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffbc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875230445403392:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359397.728386:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788359397.732132:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359397.732251:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165376 00000100:00100000:1.0:1788359397.732261:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165376 00002000:00100000:1.0:1788359397.732307:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffffa0e9c8075f80 x1875230420165376/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:723/0 lens 504/0 e 0 to 0 dl 1788359408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359397.732318:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c8075f80 with x1875230420165376 ext(0->8) 00010000:00010000:1.0:1788359397.732328:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 9 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.732348:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 9 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359397.732364:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c8075f80 00000100:00100000:1.0:1788359397.732397:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:1.0:1788359397.732405:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420165376:12345-192.168.202.52@tcp:4:lfs.0 00000100:00100000:3.0:1788359397.733259:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffbc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875230445403392:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359397.733286:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359397.735042:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2404:x1875230420165376:12345-192.168.202.52@tcp:4:lfs.0 Request processed in 2615us (2895us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788359397.735060:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00002000:00100000:1.0:1788359397.735074:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffffa0e9c8075f80 x1875230420165376/t4294967303(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:723/0 lens 504/448 e 0 to 0 dl 1788359408 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359397.735085:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c8075f80 with x1875230420165376 ext(0->8) 00010000:00010000:1.0:1788359397.735097:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359397.735121:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359397.735130:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c8075f80 00000100:00100000:1.0:1788359397.738627:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359397.738747:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165504 00000100:00100000:2.0:1788359397.738757:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165504 00010000:00010000:2.0:1788359397.738816:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359397.738951:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:2.0:1788359397.738986:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2508850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2405:x1875230420165504:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359397.739011:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788359397.739042:0:7465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788359397.739046:0:7465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788359397 00002000:00010000:2.0:1788359397.739049:0:7465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788359397 00002000:00010000:2.0:1788359397.739065:0:7465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788359397 00002000:00010000:2.0:1788359397.739074:0:7465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788359397.739081:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.739103:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.739134:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7805c97/0x49dd053b5feaec3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f95 expref: 11 pid: 8882 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.739160:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359397.739164:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359397.739170:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.739187:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359397.739230:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359397.739293:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2508850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2405:x1875230420165504:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 333us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359397.739301:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 68 00010000:00010000:0.0:1788359397.739862:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739873:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739906:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739915:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739922:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739930:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359397.739934:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739944:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739964:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.739973:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054a31538/0x49dd053b5feaec79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.740065:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420165248:12345-192.168.202.52@tcp:1:lfs.0 Request processed in 12090us (12410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.740073:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:1.0:1788359397.745061:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.745197:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165760 00000100:00100000:3.0:1788359397.745208:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165760 00000100:00100000:3.0:1788359397.745266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 26 00000100:00100000:3.0:1788359397.745277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+42:11390:x1875230420165760:12345-192.168.202.52@tcp:35:lfs.0 00000004:00010000:3.0:1788359397.745340:0:6518:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6faa expref: 42 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359397.745941:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788359397.745982:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788359397.746314:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788359397.746353:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.746369:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.746383:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.746418:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 46 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.746432:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 46 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.746447:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875230445403520:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359397.747690:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359397.756285:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6518:1875230445403520:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359397.756313:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359397.756591:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.757160:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420165888 00000100:00100000:0.0:1788359397.757168:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420165888 00010000:00010000:0.0:1788359397.757215:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 47 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.757250:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:0.0:1788359397.757260:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+47:2405:x1875230420165888:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359397.757278:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359397.757284:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 47 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.757297:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 47 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.757318:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaec25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f87 expref: 47 pid: 6516 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.757332:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:0.0:1788359397.757337:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.757345:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359397.758002:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788359397.758110:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.758136:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359397.758187:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+46:2405:x1875230420165888:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 928us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.758207:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 69 00010000:00010000:3.0:1788359397.758633:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.758643:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359397.758751:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788359397.758861:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788359397.758946:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445403648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788359397.758996:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359397.759039:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359397.759146:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445403648 00000100:00100000:2.0:1788359397.759151:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445403648 00000100:00100000:2.0:1788359397.759201:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788359397.759210:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1875230445403648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788359397.759293:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6518:x1875230445403648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359397.759300:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00010000:00010000:0.0:1788359397.759515:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788359397.759629:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359397.759665:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445403648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788359397.759767:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788359397.759804:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445403776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788359397.759828:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359397.759851:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359397.759894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445403776 00000100:00100000:1.0:1788359397.759899:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445403776 00000100:00100000:1.0:1788359397.759931:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788359397.759938:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6518:x1875230445403776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788359397.760044:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6518:x1875230445403776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (214us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788359397.760056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788359397.760988:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6518:1875230445403776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788359397.761026:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788359397.761069:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761078:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761086:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761092:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.761096:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761103:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761117:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:3.0:1788359397.761120:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788359397.761123:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.761129:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaec80 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359397.761217:0:6518:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788359397.761270:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788359397.761279:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429731783091ns, next at 430731781550ns, rc = 0 00000001:00080000:3.0:1788359397.761284:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788359397.761301:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:3.0:1788359397.761304:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788359397.761310:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaec6b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6faa expref: 50 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.761403:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d94450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+49:11390:x1875230420165760:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 16129us (16351us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788359397.761411:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 26 00000020:00080000:3.0:1788359397.761415:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788359397.766864:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.766951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420166016 00000100:00100000:3.0:1788359397.766960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420166016 00000100:00100000:3.0:1788359397.767019:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 111 00000100:00100000:3.0:1788359397.767037:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+49:11390:x1875230420166016:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359397.767063:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359397.767087:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaec87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fb1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.767144:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaec87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb1 expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.767160:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaec87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb1 expref: 50 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.767198:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359397.767202:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359397.767205:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:3.0:1788359397.767268:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+50:11390:x1875230420166016:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 240us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.767275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 111 00000100:00100000:1.0:1788359397.771155:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.771245:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420166272 00000100:00100000:0.0:1788359397.771255:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420166272 00000100:00100000:0.0:1788359397.771312:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:0.0:1788359397.771321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+50:11390:x1875230420166272:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359397.771590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+51:11390:x1875230420166272:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 270us (443us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788359397.771598:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:1.0:1788359397.847984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.848332:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420166400 00000100:00100000:0.0:1788359397.848344:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420166400 00000100:00100000:0.0:1788359397.848482:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 112 00000100:00100000:0.0:1788359397.848525:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+51:11401:x1875230420166400:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:0.0:1788359397.848767:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848786:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848799:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848812:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848820:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848827:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848948:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848956:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.848964:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359397.849035:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849050:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849057:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849064:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849071:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359397.849075:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849082:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849092:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359397.849095:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359397.849099:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849112:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaec8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849128:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849134:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849140:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849145:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359397.849148:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849153:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849161:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:0.0:1788359397.849164:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359397.849167:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849171:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaec95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849180:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849185:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849197:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849202:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea5000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359397.849205:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849212:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849218:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359397.849221:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359397.849223:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.849229:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaec9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.849310:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+51:11401:x1875230420166400:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 817us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359397.849318:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 112 00000100:00100000:1.0:1788359397.902147:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.902229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420166656 00000100:00100000:0.0:1788359397.902240:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420166656 00000100:00100000:0.0:1788359397.902301:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:0.0:1788359397.902310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+51:11404:x1875230420166656:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359397.902331:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359397.902351:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaeca3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fb8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902441:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902456:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902468:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902486:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902530:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902646:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902655:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902662:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359397.902671:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788359397.902739:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902746:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902758:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902764:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359397.902768:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902776:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902786:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359397.902789:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359397.902793:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902800:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaecaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902813:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902818:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902824:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902830:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359397.902833:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902845:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902852:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:0.0:1788359397.902853:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359397.902856:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902860:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902905:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaeca3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902920:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.902927:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359397.902929:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359397.902931:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359397.902992:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11404:x1875230420166656:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 683us (856us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788359397.902999:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:1.0:1788359397.911454:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359397.911932:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420166784 00000100:00100000:3.0:1788359397.911942:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420166784 00000100:00100000:3.0:1788359397.911996:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00100000:3.0:1788359397.912006:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11404:x1875230420166784:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:3.0:1788359397.912086:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912100:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912123:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912159:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912164:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912169:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912172:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359397.912187:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912193:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912202:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359397.912205:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359397.912208:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359397.912212:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaecc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359397.912276:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11404:x1875230420166784:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 272us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359397.912281:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00100000:1.0:1788359397.916542:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.916721:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167040 00000100:00100000:0.0:1788359397.916730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167040 00000100:00100000:0.0:1788359397.916784:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:0.0:1788359397.916793:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+53:11404:x1875230420167040:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359397.917026:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11404:x1875230420167040:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 233us (494us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788359397.917044:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:1.0:1788359397.995300:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359397.995473:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167296 00000100:00100000:0.0:1788359397.995484:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167296 00000100:00100000:0.0:1788359397.995689:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 115 00000100:00100000:0.0:1788359397.995699:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11414:x1875230420167296:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359397.995724:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359397.995726:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788359397.995748:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaec48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f9c expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995764:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359397.995767:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359397.995777:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaeccd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fbf expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995859:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995869:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995888:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995921:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359397.995953:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 54 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359397.995966:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445403904:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359397.996073:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359398.000083:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.000575:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167424 00000100:00100000:3.0:1788359398.000584:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167424 00010000:00010000:3.0:1788359398.000622:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 55 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359398.000677:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:3.0:1788359398.000687:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+55:2404:x1875230420167424:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359398.000703:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359398.000711:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 55 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.000724:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 55 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.000758:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.000763:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.000772:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.000780:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.000798:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359398.000854:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+55:2404:x1875230420167424:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 168us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.000861:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 70 00010000:00010000:0.0:1788359398.001716:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb8 expref: 54 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359398.001738:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445403904:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359398.001768:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.001777:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.001782:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359398.001800:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788359398.001928:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaeccd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 55 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.001946:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 54 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.001953:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359398.001965:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788359398.001968:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4a00, rc 0) 00000100:00100000:0.0:1788359398.002073:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11414:x1875230420167296:12345-192.168.202.52@tcp:101:bash.0 Request processed in 6375us (6782us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788359398.002080:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 115 00000100:00100000:1.0:1788359398.006288:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.006350:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167552 00000100:00100000:3.0:1788359398.006359:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167552 00000100:00100000:3.0:1788359398.006405:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 116 00000100:00100000:3.0:1788359398.006412:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+54:11414:x1875230420167552:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359398.006432:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359398.006449:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaece2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fc6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006523:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006540:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006549:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006790:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaece2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 56 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006861:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.006870:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.006872:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359398.006876:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7600, rc 0) 00000100:00100000:3.0:1788359398.007057:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+55:11414:x1875230420167552:12345-192.168.202.52@tcp:101:bash.0 Request processed in 644us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.007065:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 116 00000100:00100000:1.0:1788359398.017312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359398.017402:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167808 00000100:00100000:2.0:1788359398.017414:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167808 00000100:00100000:2.0:1788359398.017513:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 117 00000100:00100000:2.0:1788359398.017525:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+55:11414:x1875230420167808:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:2.0:1788359398.017992:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359398.018010:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359398.018022:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788359398.018085:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788359398.018109:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac525bf6 reply state 00000000be087b61 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359398.018124:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359398.018131:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359398.018134:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359398.018138:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359398.018231:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11414:x1875230420167808:12345-192.168.202.52@tcp:36:bash.0 Request processed in 708us (928us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788359398.018239:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 117 00000020:00080000:2.0:1788359398.018244:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788359398.018987:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359398.018994:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359398.019014:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788359398.019023:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788359398.023563:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359398.023857:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420167936 00000100:00100000:0.0:1788359398.023868:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420167936 00000100:00100000:0.0:1788359398.023938:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 118 00000100:00100000:0.0:1788359398.023949:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11414:x1875230420167936:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359398.023977:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359398.023997:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaecf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fcd expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.024109:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.024125:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.024134:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.024166:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.024200:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 59 pid: 10096 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359398.024213:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404032:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359398.024296:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788359398.027007:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404032:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359398.027051:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359398.027174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359398.027241:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168064 00000100:00100000:1.0:1788359398.027249:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168064 00010000:00010000:1.0:1788359398.027291:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 60 pid: 10096 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359398.027329:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 71 00000100:00100000:1.0:1788359398.027338:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:2405:x1875230420168064:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359398.027352:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359398.027358:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 60 pid: 10096 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027372:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 60 pid: 10096 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027393:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaecd4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fbf expref: 60 pid: 10096 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027425:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:1.0:1788359398.027430:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027439:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027447:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.027748:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359398.027799:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:2405:x1875230420168064:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 461us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359398.027808:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 71 00010000:00010000:0.0:1788359398.027871:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.027879:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359398.027928:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788359398.027933:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359398.027953:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.027980:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaecf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.027997:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 58 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.028004:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359398.028014:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359398.028016:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4c00, rc 0) 00000100:00100000:0.0:1788359398.028093:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c6a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11414:x1875230420167936:12345-192.168.202.52@tcp:101:bash.0 Request processed in 4146us (4540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359398.028100:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 118 00000100:00100000:2.0:1788359398.035708:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.038337:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168320 00000100:00100000:3.0:1788359398.038354:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168320 00000100:00100000:3.0:1788359398.038516:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:3.0:1788359398.038526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+58:11414:x1875230420168320:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:3.0:1788359398.038927:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11414:x1875230420168320:12345-192.168.202.52@tcp:35:bash.0 Request processed in 400us (3226us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788359398.038935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:1.0:1788359398.080809:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359398.080835:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445404160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359398.080944:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359398.081081:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445404160 00000100:00100000:3.0:1788359398.081091:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445404160 00000100:00100000:3.0:1788359398.081145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788359398.081155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445404160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359398.081190:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788359398.081246:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445404160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.081272:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788359398.081444:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445404160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359398.085746:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359398.085822:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168448 00000100:00100000:0.0:1788359398.085832:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168448 00000100:00100000:0.0:1788359398.085895:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 119 00000100:00100000:0.0:1788359398.085906:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:11420:x1875230420168448:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359398.085932:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359398.085953:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fd4 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086018:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086043:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086057:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359398.086108:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788359398.086112:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359398.086131:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086153:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fd4 expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086193:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fd4 expref: 60 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.086202:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359398.086205:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359398.086208:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4200, rc 0) 00000100:00100000:0.0:1788359398.086284:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420168448:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 379us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359398.086292:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 119 00000100:00100000:1.0:1788359398.089118:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.090611:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168576 00000100:00100000:3.0:1788359398.090626:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168576 00000100:00100000:3.0:1788359398.090943:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 120 00000100:00100000:3.0:1788359398.090956:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420168576:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359398.090982:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359398.091006:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fdb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091894:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091924:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091935:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091942:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.091947:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092038:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092048:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092072:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359398.092114:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788359398.092119:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359398.092138:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092152:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092161:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092167:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092173:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092179:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359398.092183:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092191:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092203:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:3.0:1788359398.092206:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359398.092211:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092227:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092240:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092247:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092253:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092258:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359398.092261:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092266:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092462:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:3.0:1788359398.092466:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359398.092471:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092477:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092584:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092599:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.092612:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.092614:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359398.092617:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6c00, rc 0) 00000100:00100000:3.0:1788359398.092693:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11420:x1875230420168576:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 1740us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.092702:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 120 00000100:00100000:2.0:1788359398.104756:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359398.104800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359398.104871:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168960 00000100:00100000:0.0:1788359398.104883:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168960 00000100:00100000:0.0:1788359398.104944:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00100000:0.0:1788359398.104955:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11420:x1875230420168960:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359398.104974:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359398.104994:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fe2 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105126:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105141:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105150:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105175:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105208:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105222:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359398.105236:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404288:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359398.105350:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.105359:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359398.105368:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8075880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404416:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359398.105393:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788359398.106732:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420168704 00000100:00100000:3.0:1788359398.106742:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420168704 00010000:00010000:3.0:1788359398.106774:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 63 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359398.106817:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 72 00000100:00100000:3.0:1788359398.106825:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:2404:x1875230420168704:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359398.106837:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359398.106843:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 63 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.106855:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 63 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.106875:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.106879:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.106887:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.106908:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359398.106952:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:2404:x1875230420168704:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 127us (2205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.106959:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 72 00010000:00010000:0.0:1788359398.112901:0:10096:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.52@tcp) returned -22 from blocking AST (req@00000000491ccfba x1875230445404288) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.112936:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaed28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fdb expref: 62 pid: 6517 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359398.112973:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404288:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359398.115096:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8075880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445404416:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359398.115146:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359398.115154:0:10096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.115169:0:10096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.115180:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359398.118380:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.119211:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169088 00000100:00100000:3.0:1788359398.119227:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169088 00010000:00010000:3.0:1788359398.119290:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359398.119453:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:3.0:1788359398.119467:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+62:2405:x1875230420169088:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359398.119516:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359398.119538:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119573:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119605:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaecfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fcd expref: 62 pid: 10096 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119629:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.119635:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119648:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119677:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.119721:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359398.119809:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+61:2405:x1875230420169088:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 345us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.119818:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 73 00010000:00010000:1.0:1788359398.120109:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.120120:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359398.120146:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788359398.120348:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.120378:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 61 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359398.120387:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:1.0:1788359398.120390:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788359398.120393:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eadbea4800, rc 0) 00000100:00100000:1.0:1788359398.120439:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11420:x1875230420168960:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 15486us (15638us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788359398.120447:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00100000:1.0:1788359398.125454:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359398.125856:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169344 00000100:00100000:2.0:1788359398.125871:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169344 00000100:00100000:2.0:1788359398.126001:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:2.0:1788359398.126014:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11420:x1875230420169344:12345-192.168.202.52@tcp:103:lfs.0 00010000:00010000:2.0:1788359398.126049:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359398.126085:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaec87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fb1 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359398.126283:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359398.126290:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359398.126423:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420169344:12345-192.168.202.52@tcp:103:lfs.0 Request processed in 410us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359398.126432:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:2.0:1788359398.130419:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359398.130890:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169472 00000100:00100000:0.0:1788359398.130905:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169472 00000100:00100000:0.0:1788359398.131213:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00100000:0.0:1788359398.131228:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420169472:12345-192.168.202.52@tcp:58:lfs.0 00010000:00010000:0.0:1788359398.131417:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.131439:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359398.131455:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359398.131929:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788359398.132230:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420169472:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 1004us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359398.132240:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00100000:2.0:1788359398.136332:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359398.136407:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169600 00000100:00100000:3.0:1788359398.136422:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169600 00000100:00100000:3.0:1788359398.136536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 123 00000100:00100000:3.0:1788359398.136557:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c61bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+60:11420:x1875230420169600:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359398.136592:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359398.136621:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6fe9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136697:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136709:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136733:0:6517:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136749:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136766:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359398.136789:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359398.136793:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359398.136802:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6200, rc 0) 00000100:00100000:3.0:1788359398.137731:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c61bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11420:x1875230420169600:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 1177us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359398.137742:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 123 00010000:00010000:1.0:1788359398.781054:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788359399.036765:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359399.036797:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359399.036851:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788359399.036863:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788359399.037055:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8075880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445404544:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359399.040227:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359399.044968:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8075880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445404544:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359399.046559:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359399.046658:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169728 00000100:00100000:1.0:1788359399.046671:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169728 00000100:00100000:1.0:1788359399.046780:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 124 00000100:00100000:1.0:1788359399.046794:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11421:x1875230420169728:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788359399.046840:0:10096:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788359399.047036:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11421:x1875230420169728:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 246us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359399.047047:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 124 00000100:00080000:3.0:1788359399.047386:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359399.055342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.055613:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420169856 00000100:00100000:0.0:1788359399.055628:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420169856 00000100:00100000:0.0:1788359399.055705:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 125 00000100:00100000:0.0:1788359399.055717:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11421:x1875230420169856:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788359399.055825:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055850:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055868:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055889:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055897:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055905:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055965:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055986:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.055995:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359399.056074:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788359399.056080:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359399.056096:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056121:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056129:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056138:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056144:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.056149:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056255:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056273:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:0.0:1788359399.056277:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.056285:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056302:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4c00/0x49dd053b5feaed52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056324:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056330:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056336:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056341:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea5000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.056344:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056351:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056360:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffffa0eacdd98000) 00010000:00010000:0.0:1788359399.056363:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.056366:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056372:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea5000/0x49dd053b5feaed59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056394:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056400:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056412:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056419:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.056422:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056429:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056437:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359399.056440:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.056443:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.056449:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaed60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.056640:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11421:x1875230420169856:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 Request processed in 921us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359399.056650:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 125 00000100:00100000:0.0:1788359399.070727:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.070847:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420170112 00000100:00100000:3.0:1788359399.070862:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420170112 00000100:00100000:3.0:1788359399.071003:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 126 00000100:00100000:3.0:1788359399.071026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:11421:x1875230420170112:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359399.071055:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359399.071084:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ff0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071249:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071269:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071284:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359399.071300:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788359399.071434:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071472:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071480:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071486:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359399.071492:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071552:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071568:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359399.071571:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788359399.071576:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071583:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaed6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071635:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed67 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ff0 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071647:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359399.071649:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359399.071653:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ff0 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.071663:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359399.071757:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170112:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 744us (1047us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788359399.071766:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 126 00000100:00100000:0.0:1788359399.076593:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.076692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420170240 00000100:00100000:2.0:1788359399.076713:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420170240 00000100:00100000:2.0:1788359399.076797:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 127 00000100:00100000:2.0:1788359399.076810:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170240:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788359399.076864:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788359399.077015:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170240:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 207us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.077054:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 127 00000100:00100000:2.0:1788359399.082430:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359399.082831:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420170496 00000100:00100000:1.0:1788359399.082847:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420170496 00000100:00100000:1.0:1788359399.082929:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 128 00000100:00100000:1.0:1788359399.082940:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170496:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359399.082968:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359399.082987:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788359399.083036:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4200/0x49dd053b5feaed0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fd4 expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083063:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:1.0:1788359399.083069:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359399.083087:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaed7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ff7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788359399.083660:0:6516:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788359399.083858:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaed83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083876:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaed83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083886:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaed83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083955:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaed7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ff7 expref: 64 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083973:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaed83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ff7 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.083982:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0e9c6398400) 00010000:00010000:1.0:1788359399.083985:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788359399.083989:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056200, rc 0) 00000100:00100000:1.0:1788359399.084356:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11421:x1875230420170496:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1415us (1941us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788359399.084386:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 128 00000100:00100000:3.0:1788359399.087625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.087750:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420170752 00000100:00100000:0.0:1788359399.087764:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420170752 00000100:00100000:0.0:1788359399.087847:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:0.0:1788359399.087859:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11421:x1875230420170752:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788359399.087943:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359399.088000:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaed83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ff7 expref: 63 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088038:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0e9c6398400) 00010000:00010000:0.0:1788359399.088054:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359399.088096:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088123:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088136:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088154:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088162:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088169:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088227:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088235:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088242:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088249:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.088260:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088269:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088278:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359399.088281:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.088285:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088291:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaed91 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088303:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088314:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088321:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088325:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.088328:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088334:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088341:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x55321688 (ffffa0eacdd98000) 00010000:00010000:0.0:1788359399.088343:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.088352:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.088358:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaed98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x55321688 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.088457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170752:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 599us (846us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359399.088467:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:0.0:1788359399.091532:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.091748:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420170880 00000100:00100000:3.0:1788359399.091761:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420170880 00000100:00100000:3.0:1788359399.091839:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00100000:3.0:1788359399.091851:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+62:11421:x1875230420170880:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359399.091878:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359399.091908:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed9f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e6ffe expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.091958:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.091974:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.091989:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.092370:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaed9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 64 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.092395:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 63 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.092405:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:3.0:1788359399.092409:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359399.092423:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:3.0:1788359399.092627:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11421:x1875230420170880:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 778us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.092636:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00100000:1.0:1788359399.099792:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.100451:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420171136 00000100:00100000:2.0:1788359399.100467:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420171136 00000100:00100000:2.0:1788359399.100592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 131 00000100:00100000:2.0:1788359399.100605:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+63:11421:x1875230420171136:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.100725:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.100748:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.100762:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359399.100979:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788359399.100992:0:6516:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 431071495541ns, next at 432071492361ns, rc = 0 00000004:00010000:2.0:1788359399.101080:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e9f5ca7a reply state 000000005c224f9d transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.101096:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.101115:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.101119:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788359399.103895:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359399.105085:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11421:x1875230420171136:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 4460us (5286us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788359399.105109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 131 00000001:00080000:0.0:1788359399.107968:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788359399.107995:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788359399.111244:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.111424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420171264 00000100:00100000:2.0:1788359399.111436:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420171264 00000100:00100000:2.0:1788359399.111580:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 132 00000100:00100000:2.0:1788359399.111591:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+65:11421:x1875230420171264:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.111617:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359399.111639:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7005 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.111699:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.111716:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 66 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.111737:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.111740:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359399.111743:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea600, rc 0) 00000100:00100000:2.0:1788359399.111815:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11421:x1875230420171264:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 227us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.111822:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 132 00000100:00100000:3.0:1788359399.119254:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.119534:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420171392 00000100:00100000:0.0:1788359399.119543:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420171392 00000100:00100000:0.0:1788359399.119600:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:0.0:1788359399.119608:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420171392:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788359399.119778:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420171392:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 172us (534us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788359399.119784:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00080000:3.0:1788359399.119992:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359399.122427:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.122526:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420171648 00000100:00100000:0.0:1788359399.122535:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420171648 00000100:00100000:0.0:1788359399.122636:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:0.0:1788359399.122647:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:11421:x1875230420171648:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788359399.122873:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+67:11421:x1875230420171648:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 228us (453us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788359399.122881:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:1.0:1788359399.126352:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.126606:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420171904 00000100:00100000:0.0:1788359399.126625:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420171904 00000100:00100000:0.0:1788359399.126713:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 133 00000100:00100000:0.0:1788359399.126721:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:11421:x1875230420171904:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788359399.126802:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:11421:x1875230420171904:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359399.126807:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 133 00000100:00100000:1.0:1788359399.130895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.131067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172032 00000100:00100000:2.0:1788359399.131076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172032 00000100:00100000:2.0:1788359399.131163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 134 00000100:00100000:2.0:1788359399.131172:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+67:11421:x1875230420172032:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.131191:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359399.131210:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaedbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e700c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131301:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131316:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131332:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359399.131379:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359399.131410:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131437:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaedbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e700c expref: 69 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131455:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e700c expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.131464:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.131467:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788359399.131472:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb200, rc 0) 00000100:00100000:2.0:1788359399.131847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+68:11421:x1875230420172032:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 674us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.131855:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 134 00000100:00100000:2.0:1788359399.135798:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.135883:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172160 00000100:00100000:3.0:1788359399.135893:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172160 00000100:00100000:3.0:1788359399.135953:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:3.0:1788359399.135963:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420172160:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359399.135981:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359399.136001:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7013 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788359399.136036:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9832e6, blocks: 0x0 00010000:00010000:3.0:1788359399.136058:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=431s v=(0 0) 00010000:00010000:3.0:1788359399.136063:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359399.136073:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.136091:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 10 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.136104:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359399.136211:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2405:x1875230420172160:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 249us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.136218:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:0.0:1788359399.144432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.144489:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172416 00000100:00100000:2.0:1788359399.144523:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172416 00000100:00100000:2.0:1788359399.144618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 135 00000100:00100000:2.0:1788359399.144626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+68:11421:x1875230420172416:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788359399.144725:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+68:11421:x1875230420172416:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 100us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.144730:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 135 00000100:00100000:1.0:1788359399.147044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.147109:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172544 00000100:00100000:0.0:1788359399.147117:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172544 00000100:00100000:0.0:1788359399.147162:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:0.0:1788359399.147172:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+10:11421:x1875230420172544:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359399.147193:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359399.147211:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e701a expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.147237:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.147243:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359399.147246:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359399.147250:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.147275:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.147301:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 11 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.147310:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8077800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445404672:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359399.147423:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359399.151428:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.151592:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172672 00000100:00100000:3.0:1788359399.151602:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172672 00010000:00010000:3.0:1788359399.151642:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 12 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.151658:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8077800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445404672:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359399.151686:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.151688:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00100000:3.0:1788359399.151696:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2404:x1875230420172672:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359399.151703:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8600, rc 0) 00010000:00010000:3.0:1788359399.151710:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359399.151730:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 12 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.151742:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 12 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.151748:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+12:11421:x1875230420172544:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 4578us (4712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359399.151755:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 47 00010000:00010000:3.0:1788359399.151764:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaedc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7013 expref: 12 pid: 8430 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.151777:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359399.151782:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359399.151791:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.151801:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.151833:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.151860:0:6501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1875230445404800:192.168.202.52@tcp:105: 00000100:00100000:3.0:1788359399.151910:0:6501:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2c63000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359399.154955:0:6501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6501:1875230445404800:192.168.202.52@tcp:105: 00010000:00010000:3.0:1788359399.154984:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359399.155049:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2404:x1875230420172672:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 3352us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.155060:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 74 00000100:00100000:1.0:1788359399.158729:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.158839:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172800 00000100:00100000:2.0:1788359399.158850:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172800 00002000:00100000:2.0:1788359399.158913:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffffa0eaffba6a00 x1875230420172800/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:725/0 lens 504/0 e 0 to 0 dl 1788359410 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359399.158929:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffba6a00 with x1875230420172800 ext(0->12) 00002000:00010000:2.0:1788359399.158936:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffba6a00 00000100:00100000:2.0:1788359399.158964:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:2.0:1788359399.158974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2405:x1875230420172800:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788359399.159652:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2405:x1875230420172800:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 Request processed in 674us (929us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788359399.159661:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00002000:00100000:2.0:1788359399.159669:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffffa0eaffba6a00 x1875230420172800/t4294967309(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:725/0 lens 504/448 e 0 to 0 dl 1788359410 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359399.159678:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffba6a00 with x1875230420172800 ext(0->12) 00002000:00010000:2.0:1788359399.159682:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffba6a00 00000100:00100000:1.0:1788359399.161485:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.161660:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420172928 00000100:00100000:0.0:1788359399.161669:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420172928 00000100:00100000:0.0:1788359399.161761:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 136 00000100:00100000:0.0:1788359399.161768:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+68:11421:x1875230420172928:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788359399.163270:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788359399.163285:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788359399.163329:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788359399.163345:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0eac2c636c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788359399.163351:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0eac2c63840 00000020:00080000:2.0:1788359399.163365:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0eaffab6e00 00000004:00080000:2.0:1788359399.163397:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788359399.163426:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0e9c688cb40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788359399.163429:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c688cf00 00000020:00080000:2.0:1788359399.163432:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0eaff13c000 00000020:00080000:2.0:1788359399.163442:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788359399.163454:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445404928:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1788359399.163457:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788359399.163537:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788359399.163545:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359399.163636:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11421:x1875230420172928:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 Request processed in 1866us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.163646:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 136 00000100:00100000:2.0:1788359399.163695:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445404928 00000100:00100000:2.0:1788359399.163700:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445404928 00000100:00080000:3.0:1788359399.163744:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359399.163745:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788359399.163753:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445404928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788359399.163775:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788359399.163800:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9832e5, atime: 0x6a9832e5, ctime: 0x6a9832e5, blocks: 0x8 00010000:00010000:2.0:1788359399.163806:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.163819:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=431s v=(0 0) 00010000:00010000:2.0:1788359399.163823:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359399.163828:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.163839:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.163851:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.163856:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.163870:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359399.163893:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359399.163899:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.163907:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359399.163911:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.163920:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.163935:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.163953:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098c1decd/0x49dd053b5feaedd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.163971:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359399.163973:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359399.163975:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359399.163983:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445404928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 231us (438us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788359399.163990:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788359399.164029:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788359399.164045:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967304 00000004:00080000:2.0:1788359399.164062:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffb87b80, transno 4294967302 00000004:00080000:2.0:1788359399.164079:0:3643:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967304 00000100:00100000:2.0:1788359399.164092:0:3643:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0eaffbc2a00 x1875230445404928/t4294967305(4294967305) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788359415 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788359399.164103:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffbc2a00/2, rc 0, transno 4294967305 00000100:00100000:2.0:1788359399.164107:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffbc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445404928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788359399.164121:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445405056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788359399.164149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359399.164179:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359399.164184:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445405184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788359399.164204:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359399.164233:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445405056 00000100:00100000:1.0:1788359399.164236:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445405056 00000100:00100000:1.0:1788359399.164259:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445405184 00000100:00100000:1.0:1788359399.164261:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445405184 00000100:00100000:1.0:1788359399.164274:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359399.164279:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445405056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788359399.164291:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788359399.164304:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.164318:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.164336:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788359399.164339:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359399.164344:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.164352:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788359399.164359:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445405184:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788359399.164366:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.164380:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 11 pid: 8430 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.164391:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445405312:192.168.202.52@tcp:104: 00002000:00010000:2.0:1788359399.164427:0:8882:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00000100:00100000:1.0:1788359399.164427:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00002000:00010000:2.0:1788359399.164430:0:8882:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788359398 00002000:00010000:2.0:1788359399.164432:0:8882:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788359399.164434:0:8882:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788359398 -> 1788359398 00002000:00010000:2.0:1788359399.164442:0:8882:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788359399.164471:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1875230445405184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (266us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788359399.164477:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1788359399.164524:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffba4a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788359399.164529:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445405184:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788359399.164626:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788359399.165194:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165201:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165205:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165215:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165218:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165223:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165231:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffffa0eacdd98800) 00010000:00010000:0.0:1788359399.165233:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.165236:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165240:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaead5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165255:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165258:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165261:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165264:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165266:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165269:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165279:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffffa0ead279f900) 00010000:00010000:0.0:1788359399.165280:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.165282:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165286:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaeb7d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165295:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165298:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165301:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165304:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165306:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165309:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165313:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:0.0:1788359399.165314:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.165316:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165319:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaebfb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165331:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165335:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165338:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165341:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165342:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165345:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165349:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0e9c6398e00) 00010000:00010000:0.0:1788359399.165351:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.165352:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165355:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaec1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165363:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165366:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165369:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165375:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eaa00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165377:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165380:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165384:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359399.165385:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359399.165387:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165390:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaecf0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165397:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165400:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165403:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165405:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.165407:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165410:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165420:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:0.0:1788359399.165421:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788359399.165423:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.165426:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaedad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.167001:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445405312:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359399.167041:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.167597:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.167714:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173056 00000100:00100000:2.0:1788359399.167725:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173056 00000100:00100000:2.0:1788359399.167824:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:2.0:1788359399.167834:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2404:x1875230420173056:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788359399.168409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.168773:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173184 00000100:00100000:3.0:1788359399.168779:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173184 00010000:00010000:2.0:1788359399.168902:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 13 pid: 8430 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.168968:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 75 00000100:00100000:2.0:1788359399.168977:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:2405:x1875230420173184:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359399.168989:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359399.168995:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 13 pid: 8430 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.169008:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 13 pid: 8430 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.169045:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a02887/0x49dd053b5feaeb8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f72 expref: 13 pid: 8430 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.169074:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359399.169079:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359399.169085:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.169095:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.169127:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359399.169182:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2405:x1875230420173184:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 206us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.169190:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 75 00010000:00010000:1.0:1788359399.169236:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359399.169241:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788359399.169246:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359399.169247:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1788359399.169255:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.169273:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.169294:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359399.169307:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359399.169314:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.169321:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359399.169325:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.169333:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.169344:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.169361:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad876d49/0x49dd053b5feaedde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.169377:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359399.169379:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359399.169381:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359399.169466:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445405056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5185us (5315us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788359399.169473:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788359399.169699:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788359399.169706:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788359399.169722:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffba4a80, transno 4294967310 00000100:00100000:2.0:1788359399.169776:0:3644:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0eaffba7480 x1875230445405056/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788359415 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788359399.169786:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffba7480/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788359399.169926:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445405056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788359399.169991:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420173056:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 Request processed in 2158us (2395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.169998:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:1.0:1788359399.171759:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.171836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173440 00000100:00100000:2.0:1788359399.171843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173440 00000100:00100000:2.0:1788359399.171880:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:2.0:1788359399.171897:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11421:x1875230420173440:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.171939:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359399.171958:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e700c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.171970:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.171973:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359399.171993:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.172003:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.172010:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359399.172109:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0b69e0c reply state 0000000055cf1b52 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.172118:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.172122:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.172123:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359399.172125:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359399.172187:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+17:11421:x1875230420173440:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 289us (433us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788359399.172194:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:3.0:1788359399.173291:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359399.173326:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173568 00000100:00100000:0.0:1788359399.173332:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173568 00000100:00100000:0.0:1788359399.173363:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:0.0:1788359399.173371:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420173568:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788359399.173450:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788359399.173453:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788359398 -> 1788359397 00002000:00010000:0.0:1788359399.173454:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788359397 00002000:00010000:0.0:1788359399.173456:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788359398 -> 1788359397 00002000:00010000:0.0:1788359399.173457:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788359399.173486:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420173568:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 115us (195us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788359399.173932:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:0.0:1788359399.174322:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.174372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173824 00000100:00100000:2.0:1788359399.174377:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173824 00000100:00100000:2.0:1788359399.174415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:2.0:1788359399.174420:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+17:11421:x1875230420173824:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.174452:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.174461:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.174467:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.174490:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.174521:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 17 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.174535:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445405440:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359399.174595:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359399.176120:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445405440:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359399.176140:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.176293:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.176352:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420173952 00000100:00100000:2.0:1788359399.176358:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420173952 00010000:00010000:2.0:1788359399.176386:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 18 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.176452:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 76 00000100:00100000:2.0:1788359399.176472:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+18:2405:x1875230420173952:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359399.176485:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359399.176492:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 18 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176537:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 18 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176560:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeda6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6ffe expref: 18 pid: 7748 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176574:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.176579:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176588:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176596:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.176612:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359399.176651:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+17:2405:x1875230420173952:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 180us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.176659:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 76 00010000:00010000:1.0:1788359399.176706:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176714:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176751:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176759:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176766:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176772:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359399.176776:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176783:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176802:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:1.0:1788359399.176805:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788359399.176808:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.176814:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaedec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.176866:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11421:x1875230420173824:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 Request processed in 2444us (2543us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788359399.176874:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:0.0:1788359399.178381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359399.178451:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174080 00000100:00100000:1.0:1788359399.178457:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174080 00000100:00100000:1.0:1788359399.178593:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:1.0:1788359399.178603:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420174080:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788359399.178644:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.178663:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.178669:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359399.178673:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359399.178676:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.178725:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.178745:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 7 pid: 8433 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.178760:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445405568:192.168.202.52@tcp:104: 00000100:00100000:1.0:1788359399.178817:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359399.179862:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445405568:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359399.179879:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.181625:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.181710:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174208 00000100:00100000:3.0:1788359399.181717:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174208 00010000:00010000:3.0:1788359399.181747:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 8 pid: 8433 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.181780:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 77 00000100:00100000:3.0:1788359399.181789:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420174208:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359399.181803:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359399.181822:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 8 pid: 8433 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.181832:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 8 pid: 8433 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.181849:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424a4626/0x49dd053b5feaedd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e701a expref: 8 pid: 8433 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.181871:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359399.181874:0:6501:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359399.181878:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.181884:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.181903:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359399.181950:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420174208:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 163us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.181955:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 77 00010000:00010000:1.0:1788359399.182364:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182374:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182393:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182401:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182408:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182425:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359399.182429:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182438:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182451:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.182458:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaedf3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.182820:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420174080:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 Request processed in 4218us (4440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359399.182828:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:0.0:1788359399.184382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.184423:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174464 00000100:00100000:2.0:1788359399.184430:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174464 00000100:00100000:2.0:1788359399.184474:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 139 00000100:00100000:2.0:1788359399.184483:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+16:11421:x1875230420174464:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788359399.184625:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.184642:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.184652:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.184680:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.184690:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 16 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.184701:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445405696:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359399.184752:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359399.186483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.186483:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445405696:192.168.202.52@tcp:104: 00000100:00100000:1.0:1788359399.186655:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174592 00000100:00100000:1.0:1788359399.186662:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174592 00010000:00010000:1.0:1788359399.186694:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.186723:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:1.0:1788359399.186731:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+17:2405:x1875230420174592:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359399.186733:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186743:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359399.186761:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186773:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186793:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaece9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fc6 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186807:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:1.0:1788359399.186811:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186817:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186822:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186826:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.186844:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359399.186860:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.186867:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.186888:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+16:2405:x1875230420174592:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 158us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359399.186895:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 78 00010000:00010000:2.0:1788359399.187328:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.187350:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.187359:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.187390:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.187401:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 16 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.187413:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445405824:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359399.187473:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359399.189059:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445405824:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359399.189080:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.189655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.189794:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174720 00000100:00100000:2.0:1788359399.189799:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174720 00010000:00010000:2.0:1788359399.189828:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.189861:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 79 00000100:00100000:2.0:1788359399.189870:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+17:2405:x1875230420174720:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359399.189885:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359399.189903:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.189915:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.189934:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaedb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7005 expref: 17 pid: 6515 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.189944:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:2.0:1788359399.189948:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.189955:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.189959:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.190007:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359399.190048:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.190061:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.190069:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+16:2405:x1875230420174720:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 200us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.190076:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 79 00000001:00080000:0.0:1788359399.190168:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788359399.190286:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788359399.190322:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788359399.190391:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8074000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445405952:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788359399.190430:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359399.190455:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359399.190464:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445405952 00000100:00100000:2.0:1788359399.190468:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445405952 00000100:00100000:2.0:1788359399.190532:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788359399.190540:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10096:x1875230445405952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788359399.190619:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10096:x1875230445405952:12345-0@lo:1000:mdt00_004.0 Request processed in 81us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.190636:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788359399.190857:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8074000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445405952:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788359399.190938:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788359399.190963:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8074000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445406080:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788359399.190982:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359399.190999:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788359399.191065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406080 00000100:00100000:1.0:1788359399.191070:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406080 00000100:00100000:1.0:1788359399.191104:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788359399.191112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10096:x1875230445406080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788359399.191209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10096:x1875230445406080:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (224us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788359399.191216:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788359399.191236:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8074000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445406080:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788359399.191261:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191275:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191281:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191288:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.191291:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191308:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191319:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:0.0:1788359399.191322:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359399.191326:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191332:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee01 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191352:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191355:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191359:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191362:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eadbea4a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359399.191363:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191367:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191371:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359399.191373:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359399.191376:0:10096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191390:0:10096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191396:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359399.191411:0:10096:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359399.191417:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445406208:192.168.202.52@tcp:105: 00000100:00100000:0.0:1788359399.191458:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788359399.193458:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445406208:192.168.202.52@tcp:105: 00000100:00100000:0.0:1788359399.193458:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00010000:00010000:2.0:1788359399.193487:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.193619:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420174848 00000100:00100000:3.0:1788359399.193626:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420174848 00010000:00010000:2.0:1788359399.193641:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4a00/0x49dd053b5feaed44 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193671:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193684:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193694:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.193700:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 31 00010000:00010000:2.0:1788359399.193703:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.193709:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11420:x1875230420174848:12345-192.168.202.52@tcp:49:lfs.0 00010000:00010000:2.0:1788359399.193710:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193715:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193720:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359399.193723:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193729:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193750:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359399.193753:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359399.193757:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193762:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee08 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193771:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193776:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193781:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193786:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359399.193788:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193793:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193799:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359399.193801:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359399.193804:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.193810:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaedfa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.193813:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11420:x1875230420174848:12345-192.168.202.52@tcp:49:lfs.0 Request processed in 106us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.193820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:2.0:1788359399.194268:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+19:11421:x1875230420174464:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 9783us (9888us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788359399.194276:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 139 00000020:00080000:2.0:1788359399.194280:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788359399.194777:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359399.194783:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359399.195271:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788359399.195278:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788359399.196153:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.196289:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420175104 00000100:00100000:3.0:1788359399.196297:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420175104 00000100:00100000:3.0:1788359399.196430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 140 00000100:00100000:3.0:1788359399.196441:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+19:11420:x1875230420175104:12345-192.168.202.52@tcp:58:lfs.0 00000100:00100000:1.0:1788359399.196492:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.196598:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420175360 00000100:00100000:2.0:1788359399.196602:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420175360 00000040:00080000:3.0:1788359399.196609:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788359399.196626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:2.0:1788359399.196632:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11421:x1875230420175360:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788359399.196681:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:11420:x1875230420175104:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 243us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.196689:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 140 00000004:00080000:2.0:1788359399.196864:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788359399.196894:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788359399.196918:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196928:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196935:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196940:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196944:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196948:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.196965:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788359399.197010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d92850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+21:11421:x1875230420175360:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 378us (519us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788359399.197025:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 32 00000020:00080000:2.0:1788359399.197028:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788359399.197196:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359399.197203:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.197210:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359399.197214:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.197219:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.197228:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:1.0:1788359399.197230:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788359399.197232:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.197236:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359399.197244:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359399.197245:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359399.197246:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359399.211528:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359399.211604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420175488 00000100:00100000:2.0:1788359399.211615:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420175488 00000100:00100000:2.0:1788359399.211679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 141 00000100:00100000:2.0:1788359399.211690:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+21:11423:x1875230420175488:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359399.211715:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359399.211741:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7021 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211809:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211824:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211837:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211851:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211857:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211863:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211931:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211954:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 22 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.211962:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.212002:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 22 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.212028:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 22 pid: 10096 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359399.212041:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445406336:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359399.212128:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359399.218436:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445406336:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359399.218461:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359399.219873:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.220352:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420175744 00000100:00100000:3.0:1788359399.220362:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420175744 00000100:00100000:3.0:1788359399.220420:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:2.0:1788359399.220429:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1788359399.220432:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+23:6172:x1875230420175744:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788359399.220439:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1788359399.221305:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+24:6172:x1875230420175744:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 872us (1435us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788359399.221314:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:0.0:1788359399.223208:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359399.223263:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420175872 00000100:00100000:3.0:1788359399.223273:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420175872 00010000:00010000:3.0:1788359399.223306:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 24 pid: 10096 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359399.223346:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 80 00000100:00100000:3.0:1788359399.223354:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+24:2405:x1875230420175872:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359399.223370:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359399.223377:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 24 pid: 10096 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223391:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 24 pid: 10096 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223414:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eadbea4800/0x49dd053b5feaed36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe2 expref: 24 pid: 10096 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223444:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359399.223449:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223459:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223467:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359399.223660:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359399.223713:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:2405:x1875230420175872:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 359us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359399.223720:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 80 00010000:00010000:2.0:1788359399.223821:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223831:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359399.223879:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788359399.223884:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359399.223954:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223968:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223977:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223984:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223990:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.223996:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359399.224000:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224008:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224032:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:2.0:1788359399.224036:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359399.224040:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224047:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224057:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224064:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224077:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224082:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359399.224085:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224091:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224098:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffffa0eaf6f05d00) 00010000:00010000:2.0:1788359399.224100:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359399.224103:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224108:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224143:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7021 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224157:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7021 expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359399.224164:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359399.224166:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359399.224169:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb600, rc 0) 00000100:00100000:2.0:1788359399.224448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11423:x1875230420175488:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 12758us (12952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359399.224466:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 141 00000040:00080000:1.0:1788359399.719004:0:14312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359399.719026:0:14312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359399.719071:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788359399.719082:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788359399.804678:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359400.124678:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788359400.124703:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445406464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359400.124775:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359400.124848:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445406592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359400.124871:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359400.124904:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406464 00000100:00100000:3.0:1788359400.124912:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406464 00000100:00100000:0.0:1788359400.124913:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406592 00000100:00100000:0.0:1788359400.124919:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406592 00000100:00100000:3.0:1788359400.124965:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788359400.125092:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445406464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359400.125144:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359400.125191:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445406464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359400.125380:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445406848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359400.125409:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.125423:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445407360:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.125472:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445407872:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.125510:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788359400.125516:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359400.125522:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445406592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788359400.125535:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788359400.125545:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788359400.125553:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445406976:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.125600:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445407488:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.125637:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445408000:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.125695:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406976 00000100:00100000:1.0:1788359400.125700:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406976 00000100:00100000:1.0:1788359400.125730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788359400.125737:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445406976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125772:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445406976:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359400.125778:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788359400.125808:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407488 00000100:00100000:1.0:1788359400.125812:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407488 00000100:00100000:1.0:1788359400.125836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788359400.125841:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445407488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125883:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445407488:12345-0@lo:400:kworker.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359400.125889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788359400.125927:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445406976:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.125938:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445407488:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.125965:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445406592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 446us (1091us total) trans 0 rc 0/0 00000100:00080000:1.0:1788359400.125975:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359400.125975:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788359400.125988:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445407104:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.125996:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406848 00000100:00100000:0.0:1788359400.126000:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406848 00000100:00100000:1.0:1788359400.126031:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359400.126038:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788359400.126045:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445406848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359400.126056:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359400.126057:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445407616:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.126089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359400.126094:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445406848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.126102:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788359400.126112:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445408128:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.126121:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407360 00000100:00100000:0.0:1788359400.126126:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407360 00000100:00100000:1.0:1788359400.126135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.126155:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788359400.126161:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445406720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359400.126190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.126205:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445407232:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.126224:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.126240:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445407744:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.126258:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359400.126788:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445406720 00000100:00100000:2.0:1788359400.126794:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445406720 00000100:00100000:2.0:1788359400.126817:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788359400.126824:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445406720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359400.126838:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788359400.126875:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445406720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359400.126880:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788359400.127068:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445408256:0@lo:400:kworker.0 00000100:00100000:1.0:1788359400.127096:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359400.127131:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaf6cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445406720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359400.129897:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408000 00000100:00100000:0.0:1788359400.129913:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408000 00000100:00100000:0.0:1788359400.129968:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407104 00000100:00100000:0.0:1788359400.129971:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407104 00000100:00100000:0.0:1788359400.129989:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407616 00000100:00100000:0.0:1788359400.129991:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407616 00000100:00100000:0.0:1788359400.130018:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408128 00000100:00100000:0.0:1788359400.130021:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408128 00000100:00100000:0.0:1788359400.130035:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407744 00000100:00100000:0.0:1788359400.130037:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407744 00000100:00100000:0.0:1788359400.130060:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788359400.130070:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445407360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130166:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445407360:12345-0@lo:400:kworker.0 Request processed in 87us (4707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130173:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788359400.130192:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788359400.130197:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445408000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130226:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445408000:12345-0@lo:400:kworker.0 Request processed in 29us (4561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130258:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788359400.130272:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788359400.130278:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445407104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130323:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445407104:12345-0@lo:400:kworker.0 Request processed in 46us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130330:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788359400.130342:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788359400.130347:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445407616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130374:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445407616:12345-0@lo:400:kworker.0 Request processed in 26us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130380:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788359400.130391:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788359400.130397:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445408128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130421:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445408128:12345-0@lo:400:kworker.0 Request processed in 24us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130426:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788359400.130439:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788359400.130444:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445407744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130469:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445407744:12345-0@lo:400:kworker.0 Request processed in 25us (4210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130473:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788359400.130514:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407872 00000100:00100000:0.0:1788359400.130517:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407872 00000100:00100000:0.0:1788359400.130544:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408256 00000100:00100000:0.0:1788359400.130547:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408256 00000100:00100000:0.0:1788359400.130579:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359400.130585:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445407872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130614:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445407872:12345-0@lo:400:kworker.0 Request processed in 30us (5099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130620:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359400.130631:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788359400.130636:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445408256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130663:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445408256:12345-0@lo:400:kworker.0 Request processed in 27us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.130668:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788359400.130720:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c807d180 x1875230445407744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359400.130734:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445407744:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130746:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445408256:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130756:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445407104:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130765:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445407616:0@lo:400:kworker.0 00010000:00080000:0.0:1788359400.130774:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c807d880 x1875230445408128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359400.130793:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445408128:0@lo:400:kworker.0 00000100:00080000:0.0:1788359400.130842:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359400.130847:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359400.130850:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359400.130869:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445408000:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130896:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445406848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359400.130905:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445407360:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130916:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445407872:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.130952:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445407232 00000100:00100000:0.0:1788359400.130956:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445407232 00000100:00100000:0.0:1788359400.130980:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788359400.130986:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445407232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.131032:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445407232:12345-0@lo:400:kworker.0 Request processed in 45us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359400.131038:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788359400.131062:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445407232:0@lo:400:kworker.0 00000100:00100000:0.0:1788359400.131138:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445406464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359400.131152:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445406592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359400.135273:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000040:00080000:0.0:1788359400.254407:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359400.254417:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359400.254443:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788359400.254451:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788359400.254629:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445408384:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359400.255179:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c603a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359400.264793:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359400.265255:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8076300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445408384:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788359400.265594:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420176000 00000100:00100000:2.0:1788359400.265602:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420176000 00000100:00100000:2.0:1788359400.265650:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 142 00000100:00100000:2.0:1788359400.265660:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11435:x1875230420176000:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788359400.265695:0:7748:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788359400.265808:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11435:x1875230420176000:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 149us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359400.265816:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 142 00000100:00100000:1.0:1788359400.271740:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359400.271870:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420176256 00000100:00100000:0.0:1788359400.271881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420176256 00000100:00100000:0.0:1788359400.271939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 143 00000100:00100000:0.0:1788359400.271950:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+22:11435:x1875230420176256:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359400.271982:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359400.272234:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaee32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7028 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359400.272466:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaee39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359400.272482:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaee39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359400.272682:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaee39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359400.272697:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788359400.272804:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaee32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7028 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359400.272823:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaee39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7028 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359400.272832:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359400.272835:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359400.272838:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8400, rc 0) 00000100:00100000:0.0:1788359400.272948:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+24:11435:x1875230420176256:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 999us (1217us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788359400.272956:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 143 00000100:00100000:1.0:1788359400.279898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359400.280121:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420176384 00000100:00100000:2.0:1788359400.280131:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420176384 00000100:00100000:2.0:1788359400.280199:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:2.0:1788359400.280208:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2509050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+24:2405:x1875230420176384:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359400.280225:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359400.280249:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaee39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7028 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.280299:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359400.280304:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359400.280967:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2509050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+23:2405:x1875230420176384:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 758us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359400.280977:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:1.0:1788359400.282888:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359400.283031:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420176640 00000100:00100000:2.0:1788359400.283041:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420176640 00000100:00100000:2.0:1788359400.283379:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 144 00000100:00100000:2.0:1788359400.283390:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:11435:x1875230420176640:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788359400.283470:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.283488:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.283839:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.283977:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.283986:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.283994:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.284000:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359400.284028:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.284036:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.284049:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359400.284052:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359400.284056:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359400.284063:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaee47 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359400.285529:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+24:11435:x1875230420176640:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 2105us (2612us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788359400.285541:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 144 00000040:00080000:1.0:1788359400.286845:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359400.286852:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788359400.288519:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359400.288852:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420176896 00000100:00100000:3.0:1788359400.288862:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420176896 00000100:00100000:3.0:1788359400.288919:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:3.0:1788359400.288928:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+24:11435:x1875230420176896:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788359400.289291:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:11435:x1875230420176896:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 364us (806us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788359400.289299:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 34 00000040:00080000:1.0:1788359400.291222:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788359400.291240:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788359400.830309:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788359401.428985:0:14363:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359401.432072:0:14363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359401.432131:0:14363:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788359401.432140:0:14363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788359401.577840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359401.577907:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177152 00000100:00100000:2.0:1788359401.577917:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177152 00000100:00100000:2.0:1788359401.578006:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 145 00000100:00100000:2.0:1788359401.578017:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:11456:x1875230420177152:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359401.578042:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359401.578063:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e702f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359401.578163:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359401.578178:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359401.578203:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359401.578215:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788359401.578315:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaee4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e702f expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359401.578331:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e702f expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359401.578339:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:2.0:1788359401.578343:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788359401.578346:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb800, rc 0) 00000100:00100000:2.0:1788359401.578400:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+27:11456:x1875230420177152:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 385us (567us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788359401.578406:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 145 00000100:00080000:1.0:1788359401.578680:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359401.586331:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359401.590603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177280 00000100:00100000:3.0:1788359401.590617:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177280 00000100:00100000:3.0:1788359401.590749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 146 00000100:00100000:3.0:1788359401.590759:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+27:11456:x1875230420177280:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:3.0:1788359401.590822:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590838:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590850:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590883:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590889:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590896:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590909:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359401.590914:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590921:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590932:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:3.0:1788359401.590934:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359401.590938:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359401.590945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaee63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359401.591027:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+27:11456:x1875230420177280:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 269us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359401.591034:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 146 00000100:00100000:2.0:1788359401.675060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359401.675286:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177408 00000100:00100000:0.0:1788359401.675310:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177408 00000100:00100000:0.0:1788359401.675447:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:0.0:1788359401.675468:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420177408:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:0.0:1788359401.675485:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359401.675555:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002682b73f/0x49dd053b5feaee6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7036 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359401.675580:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9832e5, atime: 0x6a9832e5, ctime: 0x6a9832e5, blocks: 0x8 00010000:00010000:0.0:1788359401.675600:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=433s v=(0 0) 00010000:00010000:0.0:1788359401.675604:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359401.675613:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002682b73f/0x49dd053b5feaee6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7036 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359401.675632:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002682b73f/0x49dd053b5feaee6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7036 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359401.675646:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9e00, rc 0) 00000100:00100000:0.0:1788359401.675698:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420177408:12345-192.168.202.52@tcp:101:cat.0 Request processed in 243us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359401.675705:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:3.0:1788359401.679073:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359401.679180:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177536 00000100:00100000:2.0:1788359401.679191:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177536 00002000:00100000:2.0:1788359401.679242:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffffa0eaffb64000 x1875230420177536/t0(0) o3->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:727/0 lens 488/0 e 0 to 0 dl 1788359412 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359401.679253:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffb64000 with x1875230420177536 ext(0->4095) 00002000:00010000:2.0:1788359401.679259:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffb64000 00000100:00100000:2.0:1788359401.679292:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:2.0:1788359401.679302:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420177536:12345-192.168.202.52@tcp:3:cat.0 00000100:00100000:2.0:1788359401.679587:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420177536:12345-192.168.202.52@tcp:3:cat.0 Request processed in 286us (522us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788359401.679595:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 3 00002000:00100000:2.0:1788359401.679602:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffffa0eaffb64000 x1875230420177536/t0(0) o3->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:727/0 lens 488/4536 e 0 to 0 dl 1788359412 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359401.679611:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffb64000 with x1875230420177536 ext(0->4095) 00002000:00010000:2.0:1788359401.679614:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffb64000 00000100:00080000:1.0:1788359401.681331:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788359401.852751:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359401.920221:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359401.920354:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177664 00000100:00100000:1.0:1788359401.920365:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177664 00000100:00100000:1.0:1788359401.920424:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 381 00000100:00100000:1.0:1788359401.920435:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420177664:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359401.921406:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420177664:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 969us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359401.921416:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 381 00000100:00100000:0.0:1788359401.926244:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359401.926442:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177920 00000100:00100000:1.0:1788359401.926452:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177920 00000100:00100000:1.0:1788359401.926569:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00100000:1.0:1788359401.926591:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420177920:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359401.926656:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420177920:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359401.926673:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00080000:0.0:1788359401.926938:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359401.929369:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359401.931588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359401.934693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359401.935174:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178176 00000100:00100000:1.0:1788359401.935185:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178176 00000100:00100000:1.0:1788359401.935283:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420177792 00000100:00100000:1.0:1788359401.935286:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420177792 00000100:00100000:1.0:1788359401.935308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 297 00000100:00100000:1.0:1788359401.935317:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420178176:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359401.935358:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 298 00000100:00100000:3.0:1788359401.935371:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420177792:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359401.935396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420178176:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 79us (6034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359401.935406:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 297 00000100:00100000:3.0:1788359401.935408:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2404:x1875230420177792:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 38us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359401.935416:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 298 00000100:00080000:3.0:1788359401.935440:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359401.936210:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178048 00000100:00100000:3.0:1788359401.936228:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178048 00000100:00100000:3.0:1788359401.936275:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 299 00000100:00100000:3.0:1788359401.936283:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420178048:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359401.936320:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb009f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2404:x1875230420178048:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 37us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359401.936327:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 299 00000100:00080000:2.0:1788359401.936384:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359402.685682:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445408512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359402.685763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359402.685878:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408512 00000100:00100000:3.0:1788359402.685887:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408512 00000100:00100000:3.0:1788359402.685941:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788359402.685957:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445408512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359402.686002:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359402.686048:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445408512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359402.686055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788359402.686246:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445408512:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359402.877791:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359403.196829:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445408640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359403.197065:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359403.197381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408640 00000100:00100000:0.0:1788359403.197402:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408640 00000100:00100000:0.0:1788359403.197522:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788359403.197533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445408640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359403.197772:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788359403.197851:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445408640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 311us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359403.197864:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788359403.197938:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445408640:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359403.900692:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788359404.742875:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1788359404.742885:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:3.0:1788359404.742895:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:2.0:1788359404.742916:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0e9c603a6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788359404.742921:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c73c6d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c603ac00 00000020:00080000:2.0:1788359404.742924:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c73c6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c803a800 00000020:00080000:2.0:1788359404.742942:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1788359404.743020:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359404.743024:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:0.0:1788359404.743032:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359404.743037:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359404.743041:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359404.743044:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359404.743049:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359404.743064:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffffa0ead279fe00) 00010000:00010000:0.0:1788359404.743066:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359404.743069:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359404.743072:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaede5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359404.743104:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788359404.744351:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1788359404.924714:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359405.245113:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaff0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445408768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359405.245224:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.245315:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408768 00000100:00100000:2.0:1788359405.245323:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408768 00000100:00100000:2.0:1788359405.245381:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788359405.245390:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445408768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359405.245421:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788359405.245508:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445408768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.245516:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788359405.245536:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359405.245566:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788359405.245572:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffba7480, transno 4294967311 00000004:00080000:2.0:1788359405.245584:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788359405.245612:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaff0c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445408768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359405.248150:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445409024:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248247:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445409536:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248317:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445410048:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248352:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445410560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359405.248373:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248396:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359405.248403:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445409152:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248470:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445409664:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248527:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445410176:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248551:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.248581:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409024 00000100:00100000:2.0:1788359405.248589:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409024 00000100:00100000:2.0:1788359405.248638:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409536 00000100:00100000:2.0:1788359405.248641:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409536 00000100:00100000:2.0:1788359405.248661:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410048 00000100:00100000:2.0:1788359405.248663:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410048 00000100:00100000:2.0:1788359405.248676:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409664 00000100:00100000:2.0:1788359405.248679:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409664 00000100:00100000:2.0:1788359405.248694:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788359405.248701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445409024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.248754:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff0c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445409024:12345-0@lo:400:kworker.0 Request processed in 52us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249030:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788359405.249048:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788359405.249055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445409536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249089:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445409536:12345-0@lo:400:kworker.0 Request processed in 35us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788359405.249106:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788359405.249112:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445410048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249138:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445410048:12345-0@lo:400:kworker.0 Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249144:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788359405.249154:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788359405.249160:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445409664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249186:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445409664:12345-0@lo:400:kworker.0 Request processed in 26us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788359405.249212:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409152 00000100:00100000:2.0:1788359405.249222:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409152 00000100:00100000:2.0:1788359405.249248:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788359405.249253:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445409152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249285:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445409152:12345-0@lo:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249291:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788359405.249307:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410176 00000100:00100000:2.0:1788359405.249311:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410176 00000100:00100000:2.0:1788359405.249336:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359405.249341:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445410176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249369:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445410176:12345-0@lo:400:kworker.0 Request processed in 27us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249374:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359405.249406:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445409152:0@lo:400:kworker.0 00010000:00080000:2.0:1788359405.249421:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c80ec380 x1875230445409664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359405.249430:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445409664:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249440:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445410176:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249449:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445409024:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445409536:0@lo:400:kworker.0 00010000:00080000:2.0:1788359405.249544:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c80eea00 x1875230445410048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359405.249552:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445410048:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249589:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445408896:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249651:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445409408:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249670:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249687:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445409920:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249715:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445410432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359405.249731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249747:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359405.249752:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445409280:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249783:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445409792:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249816:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445410304:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249833:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359405.249858:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409408 00000100:00100000:2.0:1788359405.249862:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409408 00000100:00100000:2.0:1788359405.249885:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788359405.249891:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445409408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.249925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445409408:12345-0@lo:400:kworker.0 Request processed in 34us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.249932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788359405.249948:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409920 00000100:00100000:2.0:1788359405.249950:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409920 00000100:00100000:2.0:1788359405.249983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409280 00000100:00100000:2.0:1788359405.249986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409280 00000100:00100000:2.0:1788359405.249999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788359405.250010:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445409920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250041:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875230445409920:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.250047:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788359405.250060:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788359405.250066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445409280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250091:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445409280:12345-0@lo:400:kworker.0 Request processed in 24us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.250097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788359405.250113:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445409792 00000100:00100000:2.0:1788359405.250115:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445409792 00000100:00100000:2.0:1788359405.250135:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410304 00000100:00100000:2.0:1788359405.250137:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410304 00000100:00100000:2.0:1788359405.250152:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788359405.250158:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445409792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250186:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445409792:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.250192:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788359405.250202:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788359405.250207:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445410304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250233:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445410304:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.250238:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788359405.250271:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445409280:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250280:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445409792:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250299:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788359405.250304:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffbc2a00, transno 4294967305 00000100:00100000:2.0:1788359405.250315:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445410304:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250324:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445409408:0@lo:400:kworker.0 00000100:00100000:2.0:1788359405.250332:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3643:1875230445409920:0@lo:400:kworker.0 00000100:00080000:2.0:1788359405.250445:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359405.250449:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359405.250451:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359405.250453:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359405.252661:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410560 00000100:00100000:3.0:1788359405.252671:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410560 00000100:00100000:3.0:1788359405.252712:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410432 00000100:00100000:3.0:1788359405.252715:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410432 00000100:00100000:3.0:1788359405.252732:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788359405.252742:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445410560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359405.252766:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788359405.252834:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445410560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359405.252850:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788359405.252864:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788359405.252870:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445410432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359405.252886:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359405.252919:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445410432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359405.252925:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788359405.252982:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445410560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359405.253000:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788359405.253008:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445410688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359405.253043:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359405.253071:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410688 00000100:00100000:3.0:1788359405.253074:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410688 00000100:00100000:3.0:1788359405.253091:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788359405.253096:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445410688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359405.253105:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359405.253133:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445410688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359405.253139:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788359405.253164:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445410688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359405.253193:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445410432:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359405.253695:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445408896 00000100:00100000:1.0:1788359405.253702:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445408896 00000100:00100000:1.0:1788359405.253779:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788359405.253788:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445408896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359405.253842:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac7169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445408896:12345-0@lo:400:kworker.0 Request processed in 55us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359405.253849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788359405.253912:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445408896:0@lo:400:kworker.0 00000100:00100000:1.0:1788359405.408248:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359405.413513:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178304 00000100:00100000:2.0:1788359405.413531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178304 00000100:00100000:2.0:1788359405.413794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 147 00000100:00100000:2.0:1788359405.413808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+13:11100:x1875230420178304:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788359405.413999:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+13:11100:x1875230420178304:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 Request processed in 194us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.414008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 147 00000100:00080000:0.0:1788359405.416076:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359405.417428:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359405.417704:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178432 00000100:00100000:2.0:1788359405.417715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178432 00000100:00100000:2.0:1788359405.417853:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 148 00000100:00100000:2.0:1788359405.417866:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:11100:x1875230420178432:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788359405.417995:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:11100:x1875230420178432:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 Request processed in 132us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.418003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 148 00000100:00080000:0.0:1788359405.418792:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359405.428186:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359405.428310:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178688 00000100:00100000:2.0:1788359405.428321:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178688 00000100:00100000:2.0:1788359405.428378:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:2.0:1788359405.428388:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+13:11100:x1875230420178688:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788359405.428650:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+14:11100:x1875230420178688:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 263us (477us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788359405.428655:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:1.0:1788359405.558578:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359405.559093:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178816 00000100:00100000:2.0:1788359405.559103:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178816 00000100:00080000:0.0:1788359405.559315:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359405.559516:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 149 00000100:00100000:2.0:1788359405.559530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:11914:x1875230420178816:12345-192.168.202.52@tcp:101:lsof.0 00010000:00010000:2.0:1788359405.559551:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359405.559614:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e703d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559675:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559688:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559701:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359405.559747:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788359405.559751:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359405.559785:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559822:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559852:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359405.559860:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:2.0:1788359405.559863:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359405.559867:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea400, rc 0) 00000100:00100000:2.0:1788359405.559930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:11914:x1875230420178816:12345-192.168.202.52@tcp:101:lsof.0 Request processed in 405us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359405.559937:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 149 00010000:00010000:2.0:1788359405.948727:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359406.974152:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359407.042009:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042051:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042085:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042117:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042138:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359407.042217:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179200 00000100:00100000:1.0:1788359407.042230:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179200 00000100:00100000:1.0:1788359407.042307:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179712 00000100:00100000:1.0:1788359407.042310:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179712 00000100:00100000:1.0:1788359407.042325:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179072 00000100:00100000:1.0:1788359407.042327:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179072 00000100:00100000:1.0:1788359407.042337:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179584 00000100:00100000:1.0:1788359407.042339:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179584 00000100:00100000:1.0:1788359407.042354:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 306 00000100:00100000:1.0:1788359407.042364:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420179200:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359407.042461:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420179200:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359407.042470:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 306 00000100:00100000:2.0:1788359407.042588:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179456 00000100:00100000:2.0:1788359407.042593:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179456 00000100:00100000:2.0:1788359407.042624:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179328 00000100:00100000:2.0:1788359407.042627:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179328 00000100:00100000:2.0:1788359407.042649:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 96 00000100:00100000:2.0:1788359407.042655:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420179456:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359407.042683:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420179456:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359407.042690:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 96 00000100:00100000:2.0:1788359407.042703:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:2.0:1788359407.042709:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420179328:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359407.042773:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420179328:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 62us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359407.042787:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:2.0:1788359407.042819:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 307 00000100:00100000:2.0:1788359407.042827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420179712:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359407.042856:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420179712:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359407.042862:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 307 00000100:00100000:2.0:1788359407.042877:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 308 00000100:00100000:2.0:1788359407.042883:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+14:2405:x1875230420179072:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359407.042909:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+14:2405:x1875230420179072:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359407.042914:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 308 00000100:00100000:2.0:1788359407.042923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 309 00000100:00100000:2.0:1788359407.042928:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2405:x1875230420179584:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359407.042959:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2405:x1875230420179584:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359407.042967:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 309 00000100:00080000:2.0:1788359407.043021:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359407.043026:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359407.043029:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359407.043031:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359407.043067:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420178944 00000100:00100000:0.0:1788359407.043086:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420178944 00000100:00100000:0.0:1788359407.043198:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 383 00000100:00100000:0.0:1788359407.043213:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420178944:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359407.043301:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac716bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2405:x1875230420178944:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 92us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359407.043309:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 383 00000001:02000400:0.0:1788359407.711471:0:14560:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:30:06 (1788359406) 00000100:00100000:2.0:1788359407.805669:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445410816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359407.805739:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359407.805869:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410816 00000100:00100000:3.0:1788359407.805876:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410816 00000100:00100000:3.0:1788359407.805922:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788359407.805942:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445410816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359407.805983:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359407.806042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445410816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359407.806050:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788359407.806124:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445410816:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359407.997600:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788359407.998439:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788359408.316792:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359408.316817:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445410944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359408.316886:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359408.317004:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445410944 00000100:00100000:3.0:1788359408.317019:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445410944 00000100:00100000:3.0:1788359408.317106:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788359408.317119:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445410944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359408.320330:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788359408.320482:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445410944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3360us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359408.320511:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788359408.320858:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445410944:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788359408.508733:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359408.508756:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788359408.508835:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788359408.508844:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788359408.766567:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359408.766823:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420179968 00000100:00100000:2.0:1788359408.766841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420179968 00000100:00100000:2.0:1788359408.766948:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 150 00000100:00100000:2.0:1788359408.766960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+14:12181:x1875230420179968:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359408.766989:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359408.767019:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7044 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767117:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767137:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767153:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767760:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767787:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767800:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767921:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaee94 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767961:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaee94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.767968:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaee94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359408.767982:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788359408.768071:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768079:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768086:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768092:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359408.768097:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768104:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768118:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:2.0:1788359408.768121:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359408.768126:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768137:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaee86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768151:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768162:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768168:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768173:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359408.768176:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768183:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768190:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0ead14aae00) 00010000:00010000:2.0:1788359408.768193:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359408.768196:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.768202:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaee8d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.772660:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaee7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7044 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.772695:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaee94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7044 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359408.772706:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:2.0:1788359408.772710:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359408.772730:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ebc00, rc 0) 00000100:00100000:2.0:1788359408.772817:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+16:12181:x1875230420179968:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 5857us (6272us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788359408.772825:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 150 00000100:00100000:2.0:1788359408.777896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359408.778017:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180096 00000100:00100000:0.0:1788359408.778036:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180096 00000100:00100000:0.0:1788359408.778135:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:0.0:1788359408.778147:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+16:2404:x1875230420180096:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359408.778168:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359408.778205:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaee94 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7044 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359408.778229:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:0.0:1788359408.778236:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359408.778321:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+15:2404:x1875230420180096:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 176us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359408.778352:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:1.0:1788359408.789151:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359408.789246:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180224 00000100:00100000:2.0:1788359408.789260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180224 00000100:00100000:2.0:1788359408.790003:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 151 00000100:00100000:2.0:1788359408.790019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:12181:x1875230420180224:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788359408.790165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:12181:x1875230420180224:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 150us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359408.790173:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 151 00000100:00100000:1.0:1788359408.807760:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359408.810863:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180352 00000100:00100000:3.0:1788359408.810878:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180352 00000100:00100000:3.0:1788359408.811013:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 152 00000100:00100000:3.0:1788359408.811024:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:12181:x1875230420180352:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788359408.811138:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+5:12181:x1875230420180352:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 116us (3389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359408.811145:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 152 00000040:00080000:3.0:1788359409.022141:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788359409.022312:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788359409.536941:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359409.536953:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788359409.536973:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788359409.536981:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788359410.047794:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359410.364808:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445411072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359410.364900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.364998:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411072 00000100:00100000:3.0:1788359410.365006:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411072 00000100:00100000:3.0:1788359410.365063:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788359410.365072:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445411072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359410.365102:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788359410.365154:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445411072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.365161:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788359410.365182:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359410.365221:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445411072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359410.365601:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445411328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359410.365646:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.365685:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411328 00000100:00100000:0.0:1788359410.365689:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411328 00000100:00100000:0.0:1788359410.365722:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788359410.365743:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445411328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359410.365756:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359410.365791:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445411328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.365798:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788359410.365813:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359410.365832:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445411328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359410.366145:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445411200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359410.366173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.366199:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445411712:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.366242:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445412224:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366266:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.366291:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c755ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445412736:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.366333:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788359410.366339:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445411584:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.366391:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445412096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359410.366624:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411200 00000100:00100000:1.0:1788359410.366630:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411200 00000100:00100000:1.0:1788359410.366684:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788359410.366693:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445411200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359410.366714:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788359410.366762:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445411200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.366769:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788359410.366954:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c755f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445412608:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.366985:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.367030:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445411200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359410.367059:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411712 00000100:00100000:3.0:1788359410.367063:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411712 00000100:00100000:3.0:1788359410.367095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788359410.367102:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445411712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367143:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445411712:12345-0@lo:400:kworker.0 Request processed in 41us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788359410.367167:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412224 00000100:00100000:3.0:1788359410.367171:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412224 00000100:00100000:3.0:1788359410.367192:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412736 00000100:00100000:3.0:1788359410.367195:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412736 00000100:00100000:3.0:1788359410.367206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411584 00000100:00100000:3.0:1788359410.367209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411584 00000100:00100000:3.0:1788359410.367217:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412096 00000100:00100000:3.0:1788359410.367219:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412096 00000100:00100000:3.0:1788359410.367229:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412608 00000100:00100000:3.0:1788359410.367232:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412608 00000100:00100000:3.0:1788359410.367245:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788359410.367250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445412224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367283:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445412224:12345-0@lo:400:kworker.0 Request processed in 32us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788359410.367301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788359410.367307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445412736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875230445412736:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367349:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788359410.367362:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788359410.367366:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445411584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367398:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445411584:12345-0@lo:400:kworker.0 Request processed in 31us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788359410.367414:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788359410.367420:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445412096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367445:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445412096:12345-0@lo:400:kworker.0 Request processed in 26us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1788359410.367460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788359410.367465:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445412608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367517:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445412608:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359410.367524:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788359410.367562:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445411584:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367573:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445412096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367581:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c755f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445412608:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.367589:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445411712:0@lo:400:kworker.0 00010000:00080000:3.0:1788359410.367601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c807d180 x1875230445412224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359410.367611:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445412224:0@lo:400:kworker.0 00010000:00080000:3.0:1788359410.367630:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c755ca80 x1875230445412736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359410.367900:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445411456:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.367951:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.367979:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445411968:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368001:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.368019:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445412480:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368042:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.368064:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788359410.368070:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445411840:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368091:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.368107:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c807e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445412352:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368127:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.368164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411456 00000100:00100000:0.0:1788359410.368169:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411456 00000100:00100000:0.0:1788359410.368200:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788359410.368206:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445411456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368243:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5511850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445411456:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.368249:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788359410.368279:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411968 00000100:00100000:0.0:1788359410.368283:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411968 00000100:00100000:0.0:1788359410.368305:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788359410.368311:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445411968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368343:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445411968:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.368348:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788359410.368365:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412480 00000100:00100000:0.0:1788359410.368369:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412480 00000100:00100000:0.0:1788359410.368394:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412352 00000100:00100000:0.0:1788359410.368397:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412352 00000100:00100000:0.0:1788359410.368415:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788359410.368420:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445412480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368466:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445412480:12345-0@lo:400:kworker.0 Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.368473:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788359410.368484:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788359410.368490:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445412352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368536:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445412352:12345-0@lo:400:kworker.0 Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.368552:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788359410.368582:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359410.368585:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359410.368589:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359410.368620:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445412352:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368629:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445411456:0@lo:400:kworker.0 00000100:00100000:1.0:1788359410.368775:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445411840 00000100:00100000:1.0:1788359410.368780:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445411840 00000100:00100000:1.0:1788359410.368810:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1788359410.368817:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445411840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.368860:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445411968:0@lo:400:kworker.0 00000100:00100000:3.0:1788359410.368981:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c755ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3645:1875230445412736:0@lo:400:kworker.0 00000100:00100000:1.0:1788359410.369208:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445411840:12345-0@lo:400:kworker.0 Request processed in 391us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.369216:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788359410.369368:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445412480:0@lo:400:kworker.0 00000100:00100000:0.0:1788359410.369380:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359410.369387:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445412864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359410.370037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359410.370119:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c807c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445411840:0@lo:400:kworker.0 00000100:00100000:1.0:1788359410.370223:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445412864 00000100:00100000:1.0:1788359410.370229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445412864 00000100:00100000:1.0:1788359410.370307:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788359410.370316:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445412864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359410.370337:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788359410.370428:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445412864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.370434:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788359410.370682:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445412864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788359410.393282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.393439:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180480 00000100:00100000:0.0:1788359410.393461:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180480 00000100:00100000:0.0:1788359410.393566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 153 00000100:00100000:0.0:1788359410.393576:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:12223:x1875230420180480:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359410.393599:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359410.393620:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaeea2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e704b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393683:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393712:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393723:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393739:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393746:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393752:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393808:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393814:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393821:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393827:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359410.393831:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393838:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393851:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:0.0:1788359410.393860:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.393866:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393872:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaeea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393886:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393891:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393897:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393902:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359410.393905:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393922:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393930:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0e9c6341900) 00010000:00010000:0.0:1788359410.393933:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.393935:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393941:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaeeb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393973:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaeea2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e704b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.393994:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:0.0:1788359410.393997:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.394001:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaeea2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e704b expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.394010:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8c00, rc 0) 00000100:00100000:0.0:1788359410.394066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+15:12223:x1875230420180480:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 493us (795us total) trans 0 rc 301/301 00000100:00100000:0.0:1788359410.394074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 153 00000100:00080000:1.0:1788359410.394272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359410.399481:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359410.400157:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180736 00000100:00100000:3.0:1788359410.400169:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180736 00000100:00100000:3.0:1788359410.400279:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 154 00000100:00100000:3.0:1788359410.400291:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+15:12223:x1875230420180736:12345-192.168.202.52@tcp:36:lfs.0 00010000:00010000:3.0:1788359410.400352:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359410.400379:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaff14a600/0x49dd053b5feae7f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e6f expref: 15 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.400399:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:3.0:1788359410.400404:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359410.400485:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.400526:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.400545:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.400580:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 5 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.400594:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 5 pid: 6516 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359410.400616:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445412992:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359410.400696:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1ca300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359410.402751:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80bfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445412992:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359410.402777:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359410.407807:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.409880:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180864 00000100:00100000:2.0:1788359410.409896:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180864 00010000:00010000:2.0:1788359410.410001:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 6 pid: 6516 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359410.410047:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:2.0:1788359410.410057:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2405:x1875230420180864:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359410.410080:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359410.410089:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 6 pid: 6516 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410104:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 6 pid: 6516 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410141:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaee78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e703d expref: 6 pid: 6516 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410155:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:2.0:1788359410.410161:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410396:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410404:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.410438:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359410.410519:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420180864:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 463us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359410.410527:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 81 00010000:00010000:3.0:1788359410.410624:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.410634:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.410658:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.410669:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.410677:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411289:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411302:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411310:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359410.411333:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cf7ec54 reply state 000000008b70de33 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411345:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411352:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead279f000) 00010000:00010000:3.0:1788359410.411355:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359410.411358:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788359410.411364:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788359410.411371:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411377:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411383:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411389:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359410.411393:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411401:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411409:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0eacdd98600) 00010000:00010000:3.0:1788359410.411412:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359410.411415:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411429:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeeb7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359410.411447:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cf7ec54 reply state 000000008b70de33 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411455:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.411461:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0ead279fc00) 00010000:00010000:3.0:1788359410.411464:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359410.411466:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788359410.411551:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+16:12223:x1875230420180736:12345-192.168.202.52@tcp:36:lfs.0 Request processed in 11261us (12258us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788359410.411558:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 154 00000001:00080000:3.0:1788359410.413001:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:3.0:1788359410.413021:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:3.0:1788359410.413041:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413053:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413060:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413066:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359410.413070:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413087:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413100:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0ead279fc00) 00010000:00010000:3.0:1788359410.413102:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359410.413107:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413112:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeebe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413128:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413133:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413139:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413145:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359410.413148:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413153:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413161:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead279f000) 00010000:00010000:3.0:1788359410.413163:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359410.413166:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.413181:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeec5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359410.413204:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788359410.413215:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00080000:1.0:1788359410.413891:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359410.509648:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.513536:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420180992 00000100:00100000:2.0:1788359410.513551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420180992 00000100:00100000:2.0:1788359410.513618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 155 00000100:00100000:2.0:1788359410.513628:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+12:12231:x1875230420180992:12345-192.168.202.52@tcp:101:lctl.0 00010000:00010000:2.0:1788359410.513653:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359410.513677:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7052 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513743:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513773:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513786:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359410.513832:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788359410.513836:0:6515:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359410.513860:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513886:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7052 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513904:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7052 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.513925:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:2.0:1788359410.513929:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359410.513932:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eae00, rc 0) 00000100:00100000:2.0:1788359410.514004:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:12231:x1875230420180992:12345-192.168.202.52@tcp:101:lctl.0 Request processed in 377us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359410.514011:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 155 00000100:00100000:2.0:1788359410.570180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359410.570268:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420181120 00000100:00100000:3.0:1788359410.570279:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420181120 00000100:00100000:3.0:1788359410.570343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 156 00000100:00100000:3.0:1788359410.570353:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+13:12237:x1875230420181120:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359410.570373:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359410.570393:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeeda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7059 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.570469:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.570482:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.570746:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.570893:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.570903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.570941:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571028:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571036:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571043:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359410.571080:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788359410.571083:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359410.571102:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571115:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571120:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571126:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571132:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359410.571135:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571143:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571162:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:2.0:1788359410.571164:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359410.571169:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571175:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaeee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571188:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571194:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571199:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571204:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359410.571207:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571213:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571220:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0ead14aad00) 00010000:00010000:2.0:1788359410.571222:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359410.571225:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571230:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaeee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571270:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaeeda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7059 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571284:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7059 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.571291:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359410.571294:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788359410.571296:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea000, rc 0) 00000100:00100000:2.0:1788359410.571410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+14:12237:x1875230420181120:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1058us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359410.571418:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 156 00000100:00100000:2.0:1788359410.575397:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359410.575782:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420181376 00000100:00100000:3.0:1788359410.575792:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420181376 00000100:00100000:3.0:1788359410.575888:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:3.0:1788359410.575898:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+14:12237:x1875230420181376:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359410.575931:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359410.575952:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeef6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7060 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576065:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576080:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576090:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576149:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576156:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576162:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359410.576678:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788359410.576812:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576822:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576829:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576860:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576879:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576885:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576891:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359410.576896:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576902:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576925:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359410.576929:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359410.576933:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576939:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaeefd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788359410.576951:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006805e9e8 reply state 00000000cb752a63 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576962:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.576968:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:3.0:1788359410.576971:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359410.576973:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788359410.577002:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeef6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 17 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.577023:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 16 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.577029:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:3.0:1788359410.577032:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359410.577034:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6400, rc 0) 00000100:00100000:3.0:1788359410.577095:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+17:12237:x1875230420181376:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1198us (1706us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788359410.577104:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:1.0:1788359410.581314:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.581720:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420181504 00000100:00100000:0.0:1788359410.581731:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420181504 00000100:00100000:0.0:1788359410.581840:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:0.0:1788359410.581850:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420181504:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359410.581866:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359410.581887:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7067 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359410.581980:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359410.582003:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1788359410.582008:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359410.582017:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.582036:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.582068:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8c00, rc 0) 00000100:00100000:0.0:1788359410.582129:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420181504:12345-192.168.202.52@tcp:101:bash.0 Request processed in 281us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.582137:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00080000:1.0:1788359410.582187:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359410.586138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.586195:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420181632 00000100:00100000:0.0:1788359410.586204:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420181632 00000100:00100000:0.0:1788359410.586298:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:0.0:1788359410.586308:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+6:12237:x1875230420181632:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359410.586327:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359410.586342:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e706e expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.586369:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.586375:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359410.586378:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359410.586381:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.586416:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.586427:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 7 pid: 8430 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359410.586457:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875230445413120:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359410.586668:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac11caa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359410.589444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.589451:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1875230445413120:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359410.589489:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359410.589729:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420181760 00000100:00100000:1.0:1788359410.589737:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420181760 00010000:00010000:1.0:1788359410.589772:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 8 pid: 8430 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359410.589852:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:1.0:1788359410.589862:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420181760:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359410.589877:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359410.589899:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 8 pid: 8430 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.589929:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 8 pid: 8430 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.589952:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a333e90a/0x49dd053b5feaef19 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7067 expref: 8 pid: 8430 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.589969:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359410.589973:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359410.589979:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.589988:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.590019:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359410.590046:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c755e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875230445413248:192.168.202.52@tcp:105: 00000100:00100000:1.0:1788359410.590125:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901ce40 going to sleep for 11 seconds 00010000:00010000:0.0:1788359410.590353:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9200, rc 0) 00000100:00100000:0.0:1788359410.590385:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:12237:x1875230420181632:12345-192.168.202.52@tcp:101:bash.0 Request processed in 4079us (4256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.590393:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:1.0:1788359410.592734:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c755e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875230445413248:192.168.202.52@tcp:105: 00010000:00010000:1.0:1788359410.592757:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359410.592802:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420181760:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 2941us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.592812:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:1.0:1788359410.594226:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.594320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420182016 00000100:00100000:0.0:1788359410.594328:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420182016 00000100:00100000:0.0:1788359410.594369:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:0.0:1788359410.594378:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+17:12237:x1875230420182016:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:0.0:1788359410.594820:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:12237:x1875230420182016:12345-192.168.202.52@tcp:35:bash.0 Request processed in 441us (597us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788359410.594828:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:2.0:1788359410.672587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359410.672653:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420182272 00000100:00100000:1.0:1788359410.672664:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420182272 00000100:00100000:1.0:1788359410.672778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:1.0:1788359410.672792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:12247:x1875230420182272:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359410.672819:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359410.672843:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaef27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7075 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359410.672957:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788359410.673078:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaef27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7075 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.673094:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:1.0:1788359410.673097:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359410.673102:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaef27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7075 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.673139:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057000, rc 0) 00000100:00100000:1.0:1788359410.673201:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12247:x1875230420182272:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 413us (627us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788359410.673208:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:2.0:1788359410.675631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.675720:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420182528 00000100:00100000:0.0:1788359410.675730:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420182528 00000100:00100000:0.0:1788359410.675784:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:0.0:1788359410.675794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12247:x1875230420182528:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359410.676022:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+20:12247:x1875230420182528:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 228us (398us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788359410.676046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:3.0:1788359410.745459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.745626:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420182656 00000100:00100000:0.0:1788359410.745636:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420182656 00000100:00100000:0.0:1788359410.745701:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:0.0:1788359410.745712:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+20:12253:x1875230420182656:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359410.745737:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359410.745758:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e707c expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.745896:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.745923:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.745935:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359410.745979:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788359410.745983:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359410.746000:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.746028:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e707c expref: 22 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.746048:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e707c expref: 21 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.746074:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359410.746077:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359410.746081:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9a00, rc 0) 00000100:00100000:0.0:1788359410.746147:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12253:x1875230420182656:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 438us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.746154:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:3.0:1788359410.749928:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.750064:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420182912 00000100:00100000:0.0:1788359410.750075:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420182912 00000100:00100000:0.0:1788359410.750138:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 160 00000100:00100000:0.0:1788359410.750149:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12253:x1875230420182912:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359410.750169:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359410.750189:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef43 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7083 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.750306:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.750321:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.750332:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359410.750343:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788359410.750478:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef43 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7083 expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.750558:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7083 expref: 23 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.750567:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:0.0:1788359410.750571:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359410.750574:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8800, rc 0) 00000100:00100000:0.0:1788359410.750638:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+23:12253:x1875230420182912:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 491us (737us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788359410.750645:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 160 00000100:00100000:3.0:1788359410.754761:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359410.754876:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183168 00000100:00100000:1.0:1788359410.754887:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183168 00000100:00100000:1.0:1788359410.754990:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 161 00000100:00100000:1.0:1788359410.755002:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:12253:x1875230420183168:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359410.755028:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359410.755049:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaef58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e708a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.755163:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.755176:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.755188:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359410.755201:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788359410.755303:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaef58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e708a expref: 26 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.755321:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e708a expref: 25 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.755348:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:1.0:1788359410.755351:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788359410.755354:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056600, rc 0) 00000100:00100000:1.0:1788359410.755417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12253:x1875230420183168:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 418us (666us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788359410.755425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 161 00000100:00100000:3.0:1788359410.758401:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359410.762631:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.762844:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183424 00000100:00100000:2.0:1788359410.762854:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183424 00000100:00100000:2.0:1788359410.762920:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:2.0:1788359410.762929:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2404:x1875230420183424:12345-192.168.202.52@tcp:1:lfs.0 00010000:00010000:2.0:1788359410.762973:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.762995:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.763027:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359410.763032:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359410.763037:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.763075:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.763090:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 6 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359410.763118:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445413376:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359410.763202:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359410.763431:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183296 00000100:00100000:0.0:1788359410.763436:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183296 00000100:00100000:0.0:1788359410.763479:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:0.0:1788359410.763486:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+25:2404:x1875230420183296:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359410.763527:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359410.763550:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7083 expref: 25 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.763566:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:0.0:1788359410.763570:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359410.763609:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+24:2404:x1875230420183296:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 123us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.763615:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:0.0:1788359410.770228:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445413376:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359410.770259:0:8882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359410.770337:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359410.770815:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183552 00000100:00100000:1.0:1788359410.770886:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183552 00002000:00100000:1.0:1788359410.771009:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffffa0e9c81daa00 x1875230420183552/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:736/0 lens 504/0 e 0 to 0 dl 1788359421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359410.771020:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c81daa00 with x1875230420183552 ext(0->12) 00010000:00010000:1.0:1788359410.771033:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.771050:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 7 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359410.771059:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c81daa00 00000100:00100000:1.0:1788359410.771094:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:1.0:1788359410.771204:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420183552:12345-192.168.202.52@tcp:4:lfs.0 00000100:00100000:1.0:1788359410.773054:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420183552:12345-192.168.202.52@tcp:4:lfs.0 Request processed in 1844us (2708us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788359410.773067:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00002000:00100000:1.0:1788359410.773078:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffffa0e9c81daa00 x1875230420183552/t4294967306(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:736/0 lens 504/448 e 0 to 0 dl 1788359421 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788359410.773096:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c81daa00 with x1875230420183552 ext(0->12) 00010000:00010000:1.0:1788359410.773307:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.773322:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359410.773328:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c81daa00 00000100:00100000:1.0:1788359410.788686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.791656:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183680 00000100:00100000:2.0:1788359410.791671:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183680 00010000:00010000:2.0:1788359410.791722:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359410.792023:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 83 00000100:00100000:2.0:1788359410.792035:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420183680:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359410.792050:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788359410.792067:0:10335:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788359410.792069:0:10335:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788359410 00002000:00010000:2.0:1788359410.792085:0:10335:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788359410 00002000:00010000:2.0:1788359410.792087:0:10335:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788359410 00002000:00010000:2.0:1788359410.792089:0:10335:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788359410.792096:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.792121:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.792146:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feaef20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e706e expref: 9 pid: 8433 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.792162:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359410.792167:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359410.792172:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.792182:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.792213:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359410.792276:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420183680:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 244us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359410.792283:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 83 00010000:00010000:0.0:1788359410.792339:0:8882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792350:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792370:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792379:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792388:0:8882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792395:0:8882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359410.792400:0:8882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792419:0:8882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792431:0:8882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.792450:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a9e130/0x49dd053b5feaef6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359410.792531:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420183424:12345-192.168.202.52@tcp:1:lfs.0 Request processed in 29603us (29909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.792539:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:3.0:1788359410.795479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.795635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420183936 00000100:00100000:0.0:1788359410.795645:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420183936 00000100:00100000:0.0:1788359410.795702:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:0.0:1788359410.795712:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d91450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+24:12253:x1875230420183936:12345-192.168.202.52@tcp:35:lfs.0 00000004:00010000:0.0:1788359410.795791:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e708a expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359410.796289:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788359410.796331:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788359410.796779:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788359410.797023:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.797041:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 28 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.797050:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.797097:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 28 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.797194:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 28 pid: 7748 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359410.797209:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875230445413504:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359410.797355:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359410.799624:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875230445413504:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359410.799652:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359410.800131:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359410.800261:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420184064 00000100:00100000:1.0:1788359410.800272:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420184064 00010000:00010000:1.0:1788359410.800315:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 29 pid: 7748 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359410.800357:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 84 00000100:00100000:1.0:1788359410.800367:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+29:2405:x1875230420184064:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359410.800382:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359410.800390:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 29 pid: 7748 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800402:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 29 pid: 7748 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800431:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaef0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7060 expref: 29 pid: 7748 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800464:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:1.0:1788359410.800469:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800477:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800485:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359410.800554:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359410.800598:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+28:2405:x1875230420184064:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 233us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.800606:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 84 00010000:00010000:3.0:1788359410.800956:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.800965:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359410.801067:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788359410.801247:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788359410.801334:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445413632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788359410.801382:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.801692:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1dd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359410.804012:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445413632 00000100:00100000:1.0:1788359410.804158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445413632 00000100:00100000:1.0:1788359410.804263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788359410.804274:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875230445413632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788359410.804476:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6519:x1875230445413632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 204us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359410.804484:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788359410.804533:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445413632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788359410.804708:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788359410.804796:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445413760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788359410.804837:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359410.804874:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c016c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359410.804900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445413760 00000100:00100000:1.0:1788359410.804914:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445413760 00000100:00100000:1.0:1788359410.804941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788359410.804948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6519:x1875230445413760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788359410.805056:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875230445413760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (217us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788359410.805078:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788359410.805145:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80bc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445413760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788359410.805180:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788359410.805210:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805220:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805228:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805234:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359410.805238:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805245:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805261:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:3.0:1788359410.805264:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788359410.805268:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359410.805275:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaef74 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359410.805444:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788359410.805547:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788359410.805558:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442776062121ns, next at 443776060093ns, rc = 0 00000001:00080000:3.0:1788359410.805564:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788359410.805594:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead27a2700) 00010000:00010000:3.0:1788359410.805597:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788359410.805789:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaef5f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e708a expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359410.805887:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d91450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+31:12253:x1875230420183936:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 10177us (10423us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788359410.805897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 38 00000020:00080000:3.0:1788359410.805912:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788359410.811151:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.811731:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420184192 00000100:00100000:2.0:1788359410.811742:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420184192 00000100:00100000:2.0:1788359410.811897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 162 00000100:00100000:2.0:1788359410.811918:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+31:12253:x1875230420184192:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359410.811956:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359410.811977:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaef7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7091 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.812033:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaef7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7091 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.812048:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaef7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7091 expref: 32 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.812066:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359410.812070:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359410.812074:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb000, rc 0) 00000100:00100000:2.0:1788359410.812137:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+32:12253:x1875230420184192:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 230us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359410.812145:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 162 00000100:00100000:1.0:1788359410.815340:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.815449:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420184448 00000100:00100000:2.0:1788359410.815461:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420184448 00000100:00100000:2.0:1788359410.815542:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:2.0:1788359410.815553:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+32:12253:x1875230420184448:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359410.815772:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+33:12253:x1875230420184448:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 220us (442us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788359410.815788:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:1.0:1788359410.911410:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359410.911548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420184704 00000100:00100000:2.0:1788359410.911558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420184704 00000100:00100000:2.0:1788359410.911608:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 163 00000100:00100000:2.0:1788359410.911618:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+33:12263:x1875230420184704:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359410.911659:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359410.911680:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaef82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7098 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359410.911777:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788359410.911871:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaef82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7098 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.911886:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:2.0:1788359410.911889:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359410.911893:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaef82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7098 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359410.911918:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea800, rc 0) 00000100:00100000:2.0:1788359410.911980:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+34:12263:x1875230420184704:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 363us (585us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788359410.911988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 163 00000100:00100000:1.0:1788359410.920185:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359410.920337:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420184832 00000100:00100000:0.0:1788359410.920348:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420184832 00000100:00100000:0.0:1788359410.920409:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 164 00000100:00100000:0.0:1788359410.920417:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:12263:x1875230420184832:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:0.0:1788359410.920481:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920530:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920543:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920554:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920561:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920587:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920663:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920680:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359410.920727:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920739:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920746:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920753:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920758:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359410.920763:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920770:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920780:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359410.920805:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.920811:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920817:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaef90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920832:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920838:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920844:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920849:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359410.920851:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920857:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.920865:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:0.0:1788359410.920868:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.921235:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921243:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaef97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921255:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921267:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921272:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921277:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359410.921280:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921390:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921408:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359410.921411:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359410.921414:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359410.921420:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaef9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359410.921688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:12263:x1875230420184832:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 1268us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359410.921697:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 164 00000100:00100000:1.0:1788359410.924387:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359410.924491:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420185088 00000100:00100000:3.0:1788359410.924611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420185088 00000100:00100000:3.0:1788359410.924943:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:3.0:1788359410.924955:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:12263:x1875230420185088:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:3.0:1788359410.925321:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+35:12263:x1875230420185088:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 367us (940us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788359410.925329:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:2.0:1788359411.014371:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.017568:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420185344 00000100:00100000:0.0:1788359411.017583:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420185344 00000100:00100000:0.0:1788359411.017660:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 165 00000100:00100000:0.0:1788359411.017684:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+35:12266:x1875230420185344:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359411.017710:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359411.017747:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefa5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e709f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017831:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017846:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017858:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017868:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017875:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017881:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.017997:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018005:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018012:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359411.018023:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788359411.018096:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018114:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018120:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018126:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359411.018130:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018138:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018151:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359411.018154:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359411.018158:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018164:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaefac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018177:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018183:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018189:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018194:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359411.018203:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018210:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018218:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:0.0:1788359411.018220:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359411.018222:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018228:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018264:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefa5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018277:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 37 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.018284:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.018286:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359411.018289:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8200, rc 0) 00000100:00100000:0.0:1788359411.018363:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12266:x1875230420185344:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 695us (4003us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788359411.018370:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 165 00000100:00100000:1.0:1788359411.024810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.025118:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420185472 00000100:00100000:0.0:1788359411.025129:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420185472 00000100:00100000:0.0:1788359411.025197:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 166 00000100:00100000:0.0:1788359411.025208:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12266:x1875230420185472:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:0.0:1788359411.025293:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025312:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025324:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025360:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025367:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025374:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025380:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359411.025385:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025392:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025404:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.025406:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359411.025412:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.025418:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359411.025557:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12266:x1875230420185472:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 350us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359411.025565:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 166 00000100:00100000:1.0:1788359411.032096:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.032461:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420185728 00000100:00100000:3.0:1788359411.032471:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420185728 00000100:00100000:3.0:1788359411.032552:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:3.0:1788359411.032562:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12266:x1875230420185728:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:3.0:1788359411.032799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:12266:x1875230420185728:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 238us (711us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788359411.032820:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00010000:00010000:2.0:1788359411.070642:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359411.221228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.221967:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420185984 00000100:00100000:0.0:1788359411.221978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420185984 00000100:00100000:0.0:1788359411.222046:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 167 00000100:00100000:0.0:1788359411.222056:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+38:12297:x1875230420185984:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:0.0:1788359411.222242:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359411.222264:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70a6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.222373:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.222390:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.222400:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359411.222412:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788359411.222552:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaefcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70a6 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.222571:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70a6 expref: 40 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.222580:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.222597:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359411.222601:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8a00, rc 0) 00000100:00100000:0.0:1788359411.222772:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12297:x1875230420185984:12345-192.168.202.52@tcp:101:cat.0 Request processed in 716us (1552us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788359411.222779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 167 00000100:00100000:1.0:1788359411.230580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.230732:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420186240 00000100:00100000:3.0:1788359411.230743:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420186240 00000100:00100000:3.0:1788359411.231760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:3.0:1788359411.231774:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12297:x1875230420186240:12345-192.168.202.52@tcp:35:cat.0 00000100:00100000:3.0:1788359411.232027:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+41:12297:x1875230420186240:12345-192.168.202.52@tcp:35:cat.0 Request processed in 256us (1455us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788359411.232036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:0.0:1788359411.232204:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.232308:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420186368 00000100:00100000:0.0:1788359411.232314:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420186368 00000100:00100000:0.0:1788359411.232358:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359411.232365:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+41:2405:x1875230420186368:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359411.232376:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359411.232399:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaefd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70a6 expref: 41 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.232416:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.232421:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359411.232444:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+40:2405:x1875230420186368:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359411.232451:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359411.348866:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359411.348991:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420186624 00000100:00100000:2.0:1788359411.349001:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420186624 00000100:00100000:2.0:1788359411.349068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 168 00000100:00100000:2.0:1788359411.349078:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12303:x1875230420186624:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:2.0:1788359411.349102:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359411.349104:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788359411.349132:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaef3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e707c expref: 40 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349165:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359411.349170:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359411.349184:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaefe4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70ad expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349361:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349375:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349382:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349412:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.349425:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 40 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359411.349439:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445413888:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359411.349584:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359411.352891:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.353157:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420186752 00000100:00100000:3.0:1788359411.353171:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420186752 00010000:00010000:3.0:1788359411.353224:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 41 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359411.353285:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 85 00000100:00100000:3.0:1788359411.353297:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+41:2405:x1875230420186752:12345-192.168.202.52@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788359411.353320:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445413888:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359411.353334:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359411.353347:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 41 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.353352:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.353371:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 41 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.364603:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaefba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e709f expref: 41 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.364644:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359411.364675:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.364687:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.364696:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.364743:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359411.364860:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+40:2405:x1875230420186752:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 11563us (11982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359411.364873:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 85 00010000:00010000:2.0:1788359411.368155:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.368189:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359411.368215:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788359411.368375:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaefe4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.368394:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 40 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.368403:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359411.368406:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788359411.368409:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ebc00, rc 0) 00000100:00100000:2.0:1788359411.368529:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12303:x1875230420186624:12345-192.168.202.52@tcp:101:dd.0 Request processed in 19415us (19635us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788359411.368541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 168 00000100:00100000:0.0:1788359411.377608:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.377716:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420186880 00000100:00100000:3.0:1788359411.377730:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420186880 00000100:00100000:3.0:1788359411.377808:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 169 00000100:00100000:3.0:1788359411.377821:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12303:x1875230420186880:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:3.0:1788359411.377860:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359411.377890:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeff9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70b4 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.377952:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.377969:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.377986:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.378152:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaeff9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 42 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.378183:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 41 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.378192:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359411.378195:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359411.378199:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:3.0:1788359411.378279:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+41:12303:x1875230420186880:12345-192.168.202.52@tcp:101:dd.0 Request processed in 460us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359411.378287:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 169 00000100:00100000:1.0:1788359411.385655:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.385824:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420187136 00000100:00100000:0.0:1788359411.385837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420187136 00000100:00100000:0.0:1788359411.385918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 170 00000100:00100000:0.0:1788359411.385928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+41:12303:x1875230420187136:12345-192.168.202.52@tcp:36:dd.0 00010000:00010000:0.0:1788359411.386170:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.386205:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.386220:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359411.386271:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788359411.386293:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002f950890 reply state 0000000005f02433 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.386306:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.386312:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.386315:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359411.386318:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788359411.386417:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+44:12303:x1875230420187136:12345-192.168.202.52@tcp:36:dd.0 Request processed in 490us (777us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788359411.386425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 170 00000020:00080000:0.0:1788359411.386430:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788359411.649949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359411.650081:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420187264 00000100:00100000:2.0:1788359411.650101:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420187264 00000100:00100000:2.0:1788359411.650182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 171 00000100:00100000:2.0:1788359411.650193:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+44:12317:x1875230420187264:12345-192.168.202.52@tcp:101:stat.0 00010000:00010000:2.0:1788359411.650219:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359411.650241:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf00e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650316:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650355:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650367:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650381:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650389:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650395:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650479:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650490:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650552:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650584:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.650596:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 45 pid: 6517 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359411.650622:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445414016:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359411.650719:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788359411.657215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.657323:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420187520 00000100:00100000:3.0:1788359411.657337:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420187520 00000100:00100000:3.0:1788359411.657427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:3.0:1788359411.657439:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+46:6172:x1875230420187520:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788359411.657867:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+47:6172:x1875230420187520:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 428us (666us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788359411.657877:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:2.0:1788359411.658286:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445414016:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359411.658323:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359411.660369:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.661631:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420187648 00000100:00100000:0.0:1788359411.661650:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420187648 00010000:00010000:0.0:1788359411.661709:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 47 pid: 6517 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359411.661761:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 86 00000100:00100000:0.0:1788359411.661771:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+47:2405:x1875230420187648:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359411.661790:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359411.661801:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 47 pid: 6517 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661834:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 47 pid: 6517 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661859:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaefeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ad expref: 47 pid: 6517 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661879:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.661884:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661906:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661916:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.661956:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359411.662091:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+46:2405:x1875230420187648:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 320us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359411.662098:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 86 00010000:00010000:3.0:1788359411.662221:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662230:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359411.662300:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788359411.662311:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359411.662344:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662366:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662376:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662383:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662388:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662394:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359411.662459:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662467:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662478:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359411.662481:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359411.662485:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662607:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf015 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662622:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662628:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662639:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662643:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359411.662646:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662651:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662658:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:3.0:1788359411.662660:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359411.662663:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662668:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf01c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662701:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf00e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70bb expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662715:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70bb expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.662720:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359411.662721:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359411.662723:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea600, rc 0) 00000100:00100000:2.0:1788359411.662991:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+45:12317:x1875230420187264:12345-192.168.202.52@tcp:101:stat.0 Request processed in 12798us (13059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359411.663001:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 171 00000100:00100000:3.0:1788359411.717142:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.717286:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420187904 00000100:00100000:0.0:1788359411.717302:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420187904 00000100:00100000:0.0:1788359411.717392:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 172 00000100:00100000:0.0:1788359411.717408:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+45:12323:x1875230420187904:12345-192.168.202.52@tcp:36:truncate.0 00010000:00010000:0.0:1788359411.717525:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359411.717574:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf023 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70bb expref: 45 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.717626:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.717632:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359411.717857:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.717875:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.717887:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359411.717950:0:7748:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788359411.717970:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016f9993f reply state 0000000075a31d2f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.717983:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.717987:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.717989:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359411.717992:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788359411.718176:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+47:12323:x1875230420187904:12345-192.168.202.52@tcp:36:truncate.0 Request processed in 771us (1055us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788359411.718182:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 172 00000020:00080000:0.0:1788359411.718187:0:7748:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788359411.813287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359411.814974:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420188032 00000100:00100000:2.0:1788359411.815004:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420188032 00000100:00100000:2.0:1788359411.815106:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 173 00000100:00100000:2.0:1788359411.815118:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+47:12337:x1875230420188032:12345-192.168.202.52@tcp:101:stat.0 00010000:00010000:2.0:1788359411.815153:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359411.815182:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf031 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70c2 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815273:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815290:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815304:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815317:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815345:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815353:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815733:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815745:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815753:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359411.815812:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788359411.815819:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359411.815844:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815859:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815869:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815876:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815884:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815918:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359411.815924:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815933:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815946:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359411.815949:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359411.815955:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815961:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf038 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815977:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815983:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.815989:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816556:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359411.816562:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816570:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816594:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:2.0:1788359411.816597:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359411.816601:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816607:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf03f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816651:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf031 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 49 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816667:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 48 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359411.816675:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359411.816678:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359411.816680:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eba00, rc 0) 00000100:00100000:2.0:1788359411.816772:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+48:12337:x1875230420188032:12345-192.168.202.52@tcp:101:stat.0 Request processed in 1656us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359411.816780:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 173 00000100:00100000:2.0:1788359411.899952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.900127:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420188288 00000100:00100000:0.0:1788359411.900141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420188288 00000100:00100000:0.0:1788359411.900223:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 174 00000100:00100000:0.0:1788359411.900235:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+48:12347:x1875230420188288:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359411.900289:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359411.900318:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf04d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359411.900556:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788359411.900774:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf04d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c9 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.900787:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:0.0:1788359411.900790:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359411.900794:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf04d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c9 expref: 50 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.900806:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8200, rc 0) 00000100:00100000:0.0:1788359411.900875:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+49:12347:x1875230420188288:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 643us (940us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788359411.900880:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 174 00000100:00100000:3.0:1788359411.906892:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.907098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420188544 00000100:00100000:0.0:1788359411.907112:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420188544 00000100:00100000:0.0:1788359411.907216:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:0.0:1788359411.907228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+49:12347:x1875230420188544:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359411.907577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d90850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+50:12347:x1875230420188544:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 350us (698us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788359411.907587:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:1.0:1788359411.975271:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.975578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420188800 00000100:00100000:0.0:1788359411.975592:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420188800 00000100:00100000:0.0:1788359411.975716:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 175 00000100:00100000:0.0:1788359411.975745:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+50:12353:x1875230420188800:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359411.975777:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359411.975804:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf05b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70d0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.975964:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.975981:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 51 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.975991:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.976030:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 51 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.976045:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 51 pid: 10096 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359411.976061:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445414144:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359411.976180:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359411.979847:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6516:1875230445414144:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359411.979904:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359411.985329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359411.989159:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420188928 00000100:00100000:3.0:1788359411.989175:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420188928 00010000:00010000:3.0:1788359411.989222:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 52 pid: 10096 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359411.989267:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 87 00000100:00100000:3.0:1788359411.989276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+52:2405:x1875230420188928:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359411.989291:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359411.989298:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 52 pid: 10096 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989314:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 52 pid: 10096 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989339:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf046 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70c2 expref: 52 pid: 10096 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989356:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359411.989362:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989373:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989381:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359411.989408:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359411.989567:0:6516:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.989607:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359411.989632:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788359411.989806:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf05b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 53 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.989825:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 52 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.989833:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.989836:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788359411.989838:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9a00, rc 0) 00000100:00100000:3.0:1788359411.990084:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+52:2405:x1875230420188928:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 801us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359411.990109:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 87 00000100:00100000:0.0:1788359411.990906:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+51:12353:x1875230420188800:12345-192.168.202.52@tcp:101:bash.0 Request processed in 15147us (15633us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788359411.990919:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 175 00000100:00100000:2.0:1788359411.994044:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359411.994165:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420189184 00000100:00100000:0.0:1788359411.994176:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420189184 00000100:00100000:0.0:1788359411.994233:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 176 00000100:00100000:0.0:1788359411.994242:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+51:12353:x1875230420189184:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:0.0:1788359411.994604:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.994623:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.994634:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359411.994742:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788359411.994761:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002109a664 reply state 00000000419486ab transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.994772:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359411.994778:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359411.994780:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359411.994783:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788359411.994935:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12353:x1875230420189184:12345-192.168.202.52@tcp:36:bash.0 Request processed in 694us (949us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788359411.994940:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 176 00000020:00080000:0.0:1788359411.994945:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788359412.000139:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.000548:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420189312 00000100:00100000:0.0:1788359412.000562:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420189312 00000100:00100000:0.0:1788359412.000649:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 177 00000100:00100000:0.0:1788359412.000662:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12353:x1875230420189312:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359412.000703:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.000728:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf077 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70d7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.000832:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.000846:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.000881:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.000929:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.000941:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 55 pid: 6516 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.000954:0:6517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445414272:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359412.001047:0:6517:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788359412.001115:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359412.003598:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.003687:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420189440 00000100:00100000:3.0:1788359412.003700:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420189440 00010000:00010000:3.0:1788359412.003749:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 56 pid: 6516 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359412.003795:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 88 00000100:00100000:3.0:1788359412.003805:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:2405:x1875230420189440:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359412.003825:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359412.003834:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 56 pid: 6516 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.003850:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 56 pid: 6516 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.003878:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.003884:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.003907:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.003917:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.003940:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359412.004012:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:2405:x1875230420189440:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 207us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.004042:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 88 00010000:00010000:0.0:1788359412.004364:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf062 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d0 expref: 55 pid: 6516 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.004384:0:6517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6517:1875230445414272:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359412.004408:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.004419:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.004426:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359412.004558:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788359412.004563:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359412.004589:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.004636:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf077 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d7 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.004651:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d7 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.004661:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.004664:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359412.004667:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9200, rc 0) 00000100:00100000:0.0:1788359412.004701:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12353:x1875230420189312:12345-192.168.202.52@tcp:101:bash.0 Request processed in 4043us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.004708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 177 00000100:00100000:2.0:1788359412.008343:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.008459:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420189696 00000100:00100000:0.0:1788359412.008473:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420189696 00000100:00100000:0.0:1788359412.008578:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:0.0:1788359412.008590:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12353:x1875230420189696:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:0.0:1788359412.008904:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+55:12353:x1875230420189696:12345-192.168.202.52@tcp:35:bash.0 Request processed in 305us (562us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788359412.008914:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:1.0:1788359412.079444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.079581:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420189952 00000100:00100000:0.0:1788359412.079593:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420189952 00000100:00100000:0.0:1788359412.079672:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 178 00000100:00100000:0.0:1788359412.079683:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+55:12363:x1875230420189952:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359412.079719:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.079746:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70de expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359412.079919:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788359412.080050:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf085 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70de expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.080067:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:0.0:1788359412.080071:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359412.080078:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70de expref: 57 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.080096:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8800, rc 0) 00000100:00100000:0.0:1788359412.080184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12363:x1875230420189952:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 502us (754us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788359412.080192:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 178 00000100:00100000:1.0:1788359412.083128:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.083276:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420190080 00000100:00100000:0.0:1788359412.083288:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420190080 00000100:00100000:0.0:1788359412.083358:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:0.0:1788359412.083370:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12363:x1875230420190080:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:0.0:1788359412.083464:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.083484:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.083985:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084003:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084027:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084035:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084129:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084137:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084145:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359412.084270:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084286:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084292:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084298:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084305:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.084310:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084318:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084339:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359412.084342:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.084347:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084353:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084368:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084374:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084380:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084385:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.084388:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084393:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084399:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:0.0:1788359412.084402:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.084404:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084410:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf09a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084428:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084435:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084441:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084446:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.084449:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084455:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084464:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.084466:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.084469:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.084475:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.084842:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12363:x1875230420190080:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 1469us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.084852:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 179 00000100:00100000:2.0:1788359412.090720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.090838:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420190336 00000100:00100000:0.0:1788359412.090853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420190336 00000100:00100000:0.0:1788359412.090942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:0.0:1788359412.090973:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12363:x1875230420190336:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359412.091392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+57:12363:x1875230420190336:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 420us (685us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788359412.091401:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 46 00010000:00010000:2.0:1788359412.098556:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359412.131342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.135306:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420190592 00000100:00100000:0.0:1788359412.135327:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420190592 00000100:00100000:0.0:1788359412.135426:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00100000:0.0:1788359412.135438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+57:12366:x1875230420190592:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359412.135474:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.135537:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135640:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135658:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135672:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135685:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135693:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.135699:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137139:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf0bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf0bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137179:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf0bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359412.137196:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788359412.137341:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137350:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137357:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137364:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359412.137369:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137378:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137394:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:1.0:1788359412.137398:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359412.137404:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137411:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf0af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137427:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137433:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137439:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137444:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359412.137453:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137459:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137468:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:1.0:1788359412.137470:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359412.137473:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137480:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf0b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137592:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf0a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70e5 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137610:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf0bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70e5 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.137618:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:1.0:1788359412.137621:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788359412.137624:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057a00, rc 0) 00000100:00100000:1.0:1788359412.137722:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12366:x1875230420190592:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 2285us (6393us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788359412.137732:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 180 00000100:00100000:1.0:1788359412.141560:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.141628:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.141727:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420190720 00000100:00100000:2.0:1788359412.141760:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420190720 00000100:00100000:2.0:1788359412.141846:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:2.0:1788359412.141858:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+59:2405:x1875230420190720:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359412.141879:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359412.141923:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf0bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70e5 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.141948:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359412.141954:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359412.142039:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+58:2405:x1875230420190720:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 183us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.142048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:0.0:1788359412.142394:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420190848 00000100:00100000:0.0:1788359412.142401:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420190848 00000100:00100000:0.0:1788359412.142452:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 181 00000100:00100000:0.0:1788359412.142462:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12366:x1875230420190848:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:0.0:1788359412.142583:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142604:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142618:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142673:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142680:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142687:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142694:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.142700:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142708:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142718:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.142732:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359412.142739:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.142746:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf0cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.142806:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12366:x1875230420190848:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 345us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.142813:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 181 00000100:00100000:1.0:1788359412.148074:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.148247:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191104 00000100:00100000:3.0:1788359412.148261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191104 00000100:00100000:3.0:1788359412.148333:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:3.0:1788359412.148345:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12366:x1875230420191104:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:3.0:1788359412.148679:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12366:x1875230420191104:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 336us (621us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788359412.148688:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:1.0:1788359412.159636:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.161272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.161312:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.161378:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191616 00000100:00100000:3.0:1788359412.161400:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191616 00000100:00100000:3.0:1788359412.161516:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 100 00000100:00100000:3.0:1788359412.161527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb00958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2403:x1875230420191616:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359412.161618:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb00958450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2403:x1875230420191616:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.161626:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 100 00000100:00080000:2.0:1788359412.162578:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359412.163058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.163094:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.163147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.163226:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191232 00000100:00100000:3.0:1788359412.163236:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191232 00000100:00100000:3.0:1788359412.163295:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 385 00000100:00100000:3.0:1788359412.163305:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420191232:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359412.163380:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5512450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420191232:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 76us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.163388:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 385 00000100:00100000:3.0:1788359412.163436:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191488 00000100:00100000:3.0:1788359412.163440:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191488 00000100:00100000:3.0:1788359412.163485:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 101 00000100:00100000:3.0:1788359412.163522:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420191488:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359412.163555:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2403:x1875230420191488:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.163562:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 101 00000100:00080000:3.0:1788359412.163594:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359412.164232:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191360 00000100:00100000:0.0:1788359412.164241:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191360 00000100:00100000:0.0:1788359412.164343:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191872 00000100:00100000:0.0:1788359412.164348:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191872 00000100:00080000:3.0:1788359412.164424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359412.164527:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420191744 00000100:00100000:1.0:1788359412.164532:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420191744 00000100:00100000:1.0:1788359412.164569:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 316 00000100:00100000:1.0:1788359412.164578:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420191360:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359412.164631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420191360:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 54us (5011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.164638:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 316 00000100:00100000:1.0:1788359412.164671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 317 00000100:00100000:1.0:1788359412.164679:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420191744:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359412.164705:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420191744:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.164711:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 317 00000100:00080000:3.0:1788359412.164954:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359412.165411:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 318 00000100:00100000:0.0:1788359412.165422:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420191872:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359412.165633:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420191872:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 213us (4320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.165642:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 318 00000100:00100000:1.0:1788359412.267847:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.268790:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420192128 00000100:00100000:3.0:1788359412.268805:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420192128 00000100:00100000:3.0:1788359412.268888:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 182 00000100:00100000:3.0:1788359412.268912:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12384:x1875230420192128:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:3.0:1788359412.268948:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359412.268978:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70ec expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.269118:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.269133:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.269145:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359412.269156:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788359412.269292:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ec expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.269318:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ec expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.269347:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.269351:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788359412.269356:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:3.0:1788359412.269638:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12384:x1875230420192128:12345-192.168.202.52@tcp:101:cat.0 Request processed in 729us (1808us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788359412.269644:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 182 00000100:00100000:1.0:1788359412.295637:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.295812:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420192256 00000100:00100000:0.0:1788359412.295825:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420192256 00000100:00100000:0.0:1788359412.295942:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 183 00000100:00100000:0.0:1788359412.295954:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12385:x1875230420192256:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359412.295991:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.296020:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70f3 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296116:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296152:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296166:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359412.296226:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788359412.296231:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359412.296257:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296291:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70f3 expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296314:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70f3 expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.296324:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359412.296328:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359412.296332:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8e00, rc 0) 00000100:00100000:0.0:1788359412.296587:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12385:x1875230420192256:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 635us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.296595:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 183 00000100:00100000:0.0:1788359412.304715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.304839:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420192640 00000100:00100000:2.0:1788359412.304853:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420192640 00000100:00100000:2.0:1788359412.304932:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 48 00000100:00100000:2.0:1788359412.304945:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12385:x1875230420192640:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359412.305331:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12385:x1875230420192640:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 388us (630us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788359412.305341:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 48 00000100:00100000:1.0:1788359412.311019:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.311115:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420192768 00000100:00100000:3.0:1788359412.311129:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420192768 00000100:00100000:3.0:1788359412.311221:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:3.0:1788359412.311233:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12385:x1875230420192768:12345-192.168.202.52@tcp:103:lfs.0 00010000:00010000:3.0:1788359412.311255:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788359412.311289:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf07e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70d7 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.311315:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70ec expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.311330:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaef7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7091 expref: 61 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.311341:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.311346:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359412.311433:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12385:x1875230420192768:12345-192.168.202.52@tcp:103:lfs.0 Request processed in 203us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.311441:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:1.0:1788359412.315468:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.315656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420192896 00000100:00100000:3.0:1788359412.315672:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420192896 00000100:00100000:3.0:1788359412.315749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 184 00000100:00100000:3.0:1788359412.315760:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12385:x1875230420192896:12345-192.168.202.52@tcp:58:lfs.0 00010000:00010000:3.0:1788359412.315941:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.315964:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.315978:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788359412.316111:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788359412.316208:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12385:x1875230420192896:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 449us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.316216:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 184 00000100:00100000:0.0:1788359412.330018:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.330157:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193024 00000100:00100000:3.0:1788359412.330171:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193024 00000100:00100000:3.0:1788359412.330258:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 185 00000100:00100000:3.0:1788359412.330272:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12387:x1875230420193024:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359412.330301:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359412.330327:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e70fa expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330464:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330482:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330553:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330570:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330578:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330584:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330674:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330682:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330688:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359412.330740:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788359412.330745:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359412.330768:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330784:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330794:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330811:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330817:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330825:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359412.330830:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330838:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330852:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359412.330854:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359412.330859:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330866:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330882:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330899:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330906:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330912:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359412.330922:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330928:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330935:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:3.0:1788359412.330938:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359412.330941:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330947:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf10a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330978:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf0fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 62 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330991:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 61 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.330999:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.331001:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359412.331004:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7600, rc 0) 00000100:00100000:3.0:1788359412.331086:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12387:x1875230420193024:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 818us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.331095:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 185 00000040:00080000:3.0:1788359412.604801:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359412.604815:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788359412.604903:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788359412.604915:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359412.605107:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80bed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445414400:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788359412.605379:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c01540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359412.621379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.621709:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80bed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445414400:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788359412.622382:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193152 00000100:00100000:2.0:1788359412.622491:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193152 00000100:00100000:2.0:1788359412.622631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 186 00000100:00100000:2.0:1788359412.622645:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12398:x1875230420193152:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788359412.622696:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788359412.622904:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12398:x1875230420193152:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 262us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.622918:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 186 00000100:00100000:0.0:1788359412.628917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.629085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193280 00000100:00100000:2.0:1788359412.629099:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193280 00000100:00100000:2.0:1788359412.629212:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:2.0:1788359412.629223:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12398:x1875230420193280:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788359412.629329:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629351:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629366:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629617:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629642:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629656:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629706:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629716:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629724:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359412.629804:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788359412.629809:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359412.629824:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629836:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629843:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629850:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629857:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359412.629861:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629868:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629881:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:2.0:1788359412.629884:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359412.629900:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629907:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf118 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629920:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629937:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629943:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629948:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359412.629952:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629959:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629967:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffffa0ead14aa500) 00010000:00010000:2.0:1788359412.629969:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359412.629972:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629978:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf11f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629993:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.629999:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.630005:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.630010:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359412.630017:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.630023:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.630030:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359412.630033:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359412.630036:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.630042:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf126 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.630140:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12398:x1875230420193280:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 Request processed in 914us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.630150:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 187 00000100:00100000:3.0:1788359412.642745:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.642876:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193536 00000100:00100000:0.0:1788359412.642911:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193536 00000100:00100000:0.0:1788359412.642988:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:0.0:1788359412.643001:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+61:12398:x1875230420193536:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359412.643031:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.643061:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf12d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7101 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643204:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643223:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643237:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359412.643251:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788359412.643353:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643362:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643369:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643376:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.643381:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643403:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643575:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.643580:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359412.643587:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643594:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643642:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf12d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7101 expref: 63 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643655:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:0.0:1788359412.643658:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359412.643661:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf12d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7101 expref: 63 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.643672:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9800, rc 0) 00000100:00100000:0.0:1788359412.643754:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420193536:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 756us (1021us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788359412.643824:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 188 00000100:00100000:0.0:1788359412.659738:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.659962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193664 00000100:00100000:3.0:1788359412.659977:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193664 00000100:00100000:3.0:1788359412.660053:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:3.0:1788359412.660067:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420193664:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788359412.660121:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788359412.660291:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420193664:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 217us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.660369:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 189 00000100:00100000:2.0:1788359412.662993:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.663561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420193920 00000100:00100000:0.0:1788359412.663578:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420193920 00000100:00100000:0.0:1788359412.663669:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00100000:0.0:1788359412.663682:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420193920:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359412.663714:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.663718:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788359412.663780:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf0ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70f3 expref: 62 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.663801:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359412.663807:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359412.663824:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf142 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7108 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788359412.664369:0:6517:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788359412.664827:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.664846:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.664859:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.664945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf142 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7108 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.664964:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7108 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.664974:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341e00) 00010000:00010000:0.0:1788359412.664977:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359412.664980:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9600, rc 0) 00000100:00100000:0.0:1788359412.665077:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12398:x1875230420193920:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1398us (2097us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788359412.665102:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 190 00000100:00100000:3.0:1788359412.672114:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.672230:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420194176 00000100:00100000:0.0:1788359412.672243:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420194176 00000100:00100000:0.0:1788359412.672326:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 191 00000100:00100000:0.0:1788359412.672338:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12398:x1875230420194176:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788359412.672418:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359412.672467:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7108 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672491:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341e00) 00010000:00010000:0.0:1788359412.672541:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359412.672573:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672601:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672612:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672856:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672884:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672911:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672986:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.672995:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673003:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673009:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.673014:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673021:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673033:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359412.673036:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.673041:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673048:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf157 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673065:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673071:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673078:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673091:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.673095:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673102:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673113:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2e9985db (ffffa0e9c6341900) 00010000:00010000:0.0:1788359412.673116:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.673120:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.673126:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf15e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2e9985db bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.673237:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420194176:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 898us (1136us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359412.673248:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 191 00000100:00100000:2.0:1788359412.676605:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.676907:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420194304 00000100:00100000:0.0:1788359412.676920:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420194304 00000100:00100000:0.0:1788359412.676996:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 192 00000100:00100000:0.0:1788359412.677009:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+62:12398:x1875230420194304:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359412.677036:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.677068:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf165 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e710f expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677110:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677146:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677159:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677304:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 64 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677323:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.677333:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:0.0:1788359412.677335:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359412.677339:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9c00, rc 0) 00000100:00100000:0.0:1788359412.677700:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12398:x1875230420194304:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 693us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.677709:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 192 00000100:00100000:0.0:1788359412.683189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.683480:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420194560 00000100:00100000:1.0:1788359412.683509:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420194560 00000100:00100000:1.0:1788359412.683584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 193 00000100:00100000:1.0:1788359412.683596:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12398:x1875230420194560:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788359412.683714:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.683756:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.683837:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788359412.684087:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788359412.684098:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444654602349ns, next at 445654599440ns, rc = 0 00000004:00010000:1.0:1788359412.684169:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d30de7ec reply state 00000000083e6596 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.684185:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.684193:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.684196:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788359412.684201:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788359412.684399:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12398:x1875230420194560:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 802us (1225us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788359412.684407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 193 00000100:00100000:3.0:1788359412.687733:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.691454:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420194688 00000100:00100000:0.0:1788359412.691477:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420194688 00000100:00100000:0.0:1788359412.691743:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 194 00000100:00100000:0.0:1788359412.691756:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12398:x1875230420194688:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359412.691787:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359412.691815:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7116 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.691918:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.691936:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.691960:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:0.0:1788359412.691963:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359412.691969:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8000, rc 0) 00000100:00100000:0.0:1788359412.692064:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12398:x1875230420194688:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 311us (4582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.692072:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 194 00000100:00100000:0.0:1788359412.700456:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.704108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420194816 00000100:00100000:1.0:1788359412.704124:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420194816 00000100:00100000:3.0:1788359412.704292:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:3.0:1788359412.704307:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+6:2405:x1875230420194816:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788359412.704697:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420194816:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 392us (4254us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788359412.704706:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:0.0:1788359412.712078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.717783:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195072 00000100:00100000:3.0:1788359412.717807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195072 00000100:00100000:3.0:1788359412.717908:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:3.0:1788359412.717922:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12398:x1875230420195072:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788359412.718284:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12398:x1875230420195072:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 364us (6220us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788359412.718302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:1.0:1788359412.720856:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.720934:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195328 00000100:00100000:0.0:1788359412.720948:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195328 00000100:00100000:0.0:1788359412.721027:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 195 00000100:00100000:0.0:1788359412.721041:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12398:x1875230420195328:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788359412.721195:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12398:x1875230420195328:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 157us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359412.721205:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 195 00000100:00100000:3.0:1788359412.725419:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.725473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195456 00000100:00100000:1.0:1788359412.725490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195456 00000100:00100000:1.0:1788359412.725825:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 196 00000100:00100000:1.0:1788359412.725838:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12398:x1875230420195456:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359412.725866:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359412.725914:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf181 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e711d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726007:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726022:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726039:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359412.726099:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788359412.726125:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726152:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf181 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e711d expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726165:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e711d expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.726173:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.726176:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788359412.726179:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057000, rc 0) 00000100:00100000:1.0:1788359412.726262:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12398:x1875230420195456:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 427us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.726270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 196 00000100:00100000:1.0:1788359412.732451:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.732732:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195584 00000100:00100000:3.0:1788359412.732746:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195584 00000100:00100000:3.0:1788359412.732810:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359412.732822:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420195584:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359412.732848:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359412.732874:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7124 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788359412.732923:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9832f4, blocks: 0x0 00010000:00010000:3.0:1788359412.732950:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788359412.732957:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359412.732968:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.733003:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.733022:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6400, rc 0) 00000100:00100000:3.0:1788359412.733102:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420195584:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 282us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.733110:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:1.0:1788359412.737987:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.738085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195840 00000100:00100000:2.0:1788359412.738097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195840 00000100:00100000:2.0:1788359412.738171:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 197 00000100:00100000:2.0:1788359412.738183:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12398:x1875230420195840:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788359412.738325:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12398:x1875230420195840:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.738333:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 197 00000100:00100000:0.0:1788359412.741951:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.742153:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420195968 00000100:00100000:1.0:1788359412.742165:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420195968 00000100:00100000:1.0:1788359412.742274:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:1.0:1788359412.742286:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:12398:x1875230420195968:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359412.742309:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359412.742331:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e712b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.742372:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.742382:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359412.742387:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359412.742393:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 9 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.742440:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.742458:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 9 pid: 8433 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.742476:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7796680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875230445414528:192.168.202.52@tcp:104: 00000100:00100000:1.0:1788359412.742615:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359412.746882:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.746947:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196096 00000100:00100000:2.0:1788359412.746961:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196096 00010000:00010000:2.0:1788359412.747802:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 10 pid: 8433 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.747867:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:2.0:1788359412.747880:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2508450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2404:x1875230420196096:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359412.747915:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359412.747949:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 10 pid: 8433 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.748329:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7796680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875230445414528:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359412.748375:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 10 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.748411:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02056200, rc 0) 00000100:00100000:1.0:1788359412.748514:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:12398:x1875230420195968:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 6209us (6555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.748526:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 60 00010000:00010000:2.0:1788359412.748869:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 9 pid: 8433 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.748912:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da31e52b/0x49dd053b5feaf18f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7124 expref: 9 pid: 8433 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.748927:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359412.748933:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359412.748943:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.748956:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.751308:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.751368:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445414656:192.168.202.52@tcp:105: 00000100:00100000:2.0:1788359412.752305:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359412.760657:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445414656:192.168.202.52@tcp:105: 00010000:00010000:1.0:1788359412.760694:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359412.760768:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2508450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420196096:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 12890us (13902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.760783:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 89 00000100:00100000:1.0:1788359412.762005:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.762086:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196224 00000100:00100000:0.0:1788359412.762098:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196224 00002000:00100000:0.0:1788359412.762161:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffffa0e9c7797480 x1875230420196224/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:738/0 lens 504/0 e 0 to 0 dl 1788359423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359412.762186:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c7797480 with x1875230420196224 ext(0->8) 00002000:00010000:0.0:1788359412.762205:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c7797480 00000100:00100000:0.0:1788359412.762334:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:0.0:1788359412.762346:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420196224:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788359412.763782:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2405:x1875230420196224:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 Request processed in 1429us (1777us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788359412.763796:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00002000:00100000:0.0:1788359412.763809:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffffa0e9c7797480 x1875230420196224/t4294967315(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:738/0 lens 504/448 e 0 to 0 dl 1788359423 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359412.763820:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c7797480 with x1875230420196224 ext(0->8) 00002000:00010000:0.0:1788359412.763826:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c7797480 00000100:00100000:1.0:1788359412.770625:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.770980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196352 00000100:00100000:3.0:1788359412.770994:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196352 00000100:00100000:3.0:1788359412.771093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:3.0:1788359412.771105:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12398:x1875230420196352:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788359412.773988:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788359412.774013:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788359412.774076:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788359412.774095:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0eaff1dd780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788359412.774100:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0eaff1dd000 00000020:00080000:2.0:1788359412.774104:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c80fa400 00000020:00080000:2.0:1788359412.774380:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788359412.774469:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788359412.774634:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445414784:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788359412.774735:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774750:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774758:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774765:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.774770:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774778:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774818:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2200) 00010000:00010000:0.0:1788359412.774821:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.774828:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774835:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaef04 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774876:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774883:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774899:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774904:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.774907:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774913:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774922:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.774924:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.774928:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774933:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf007 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774956:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774962:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774969:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774974:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.774977:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774983:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.774991:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.774993:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.774996:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775001:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf02a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775011:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775018:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775023:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775034:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.775037:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775044:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775053:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.775054:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359412.775057:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775063:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf070 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775076:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775082:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775088:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775092:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.775095:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775102:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775121:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:0.0:1788359412.775124:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788359412.775127:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.775133:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf173 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.775321:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12398:x1875230420196352:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 Request processed in 4212us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.775334:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 198 00000100:00100000:3.0:1788359412.775972:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359412.776056:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445414912:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788359412.776098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359412.776139:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445414784 00000100:00100000:3.0:1788359412.776150:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445414784 00000100:00100000:3.0:1788359412.776446:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445414912 00000100:00100000:3.0:1788359412.776451:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445414912 00000100:00100000:3.0:1788359412.776633:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788359412.776645:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445414784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788359412.776814:0:8882:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788359412.776818:0:8882:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788359412 00002000:00010000:3.0:1788359412.776821:0:8882:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788359412.776824:0:8882:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788359412 -> 1788359412 00002000:00010000:3.0:1788359412.776827:0:8882:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788359412.776880:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445414784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 238us (909us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788359412.776902:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788359412.776919:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788359412.776926:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445414912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788359412.776944:0:8882:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1788359412.776976:0:8882:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9832f2, atime: 0x6a9832f2, ctime: 0x6a9832f2, blocks: 0x8 00010000:00010000:3.0:1788359412.776985:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.777025:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=444s v=(0 0) 00010000:00010000:3.0:1788359412.779659:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359412.779688:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.779719:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.779737:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.779748:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.779783:0:8882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359412.779926:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359412.779935:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.779945:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359412.779950:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.779959:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.779982:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.780014:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf19d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.780036:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359412.780039:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359412.780041:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359412.780257:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445414912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3325us (4153us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788359412.780270:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788359412.780311:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359412.780318:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788359412.780379:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0e9c81da300/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788359412.780388:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445414784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788359412.780725:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0e9c81d9180/2, rc 0, transno 4294967308 00000100:00100000:1.0:1788359412.780732:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445414912:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788359412.782390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.782517:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196480 00000100:00100000:1.0:1788359412.782713:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196480 00000100:00100000:1.0:1788359412.782788:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:1.0:1788359412.782800:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2404:x1875230420196480:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788359412.785404:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788359412.785418:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788359412.786702:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420196480:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 Request processed in 3891us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.786718:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:0.0:1788359412.791175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.791740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196736 00000100:00100000:1.0:1788359412.791755:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196736 00000100:00100000:1.0:1788359412.791833:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 199 00000100:00100000:1.0:1788359412.791846:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12398:x1875230420196736:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788359412.791934:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359412.791975:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e711d expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.791996:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.792003:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359412.793162:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.793212:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.793227:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359412.793414:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000722b3833 reply state 00000000744a421a transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.793430:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.793439:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.793443:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359412.793447:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788359412.794982:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:12398:x1875230420196736:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 3128us (3807us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788359412.794997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 199 00000100:00100000:3.0:1788359412.804119:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.804275:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420196864 00000100:00100000:0.0:1788359412.804290:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420196864 00000100:00100000:0.0:1788359412.804366:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:0.0:1788359412.804379:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420196864:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788359412.804655:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788359412.804660:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788359412 -> 1788359411 00002000:00010000:0.0:1788359412.804662:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788359410 00002000:00010000:0.0:1788359412.804665:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788359412 -> 1788359411 00002000:00010000:0.0:1788359412.804667:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788359412.804735:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420196864:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 359us (632us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788359412.804744:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:0.0:1788359412.810409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.810633:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197120 00000100:00100000:1.0:1788359412.810648:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197120 00000100:00100000:1.0:1788359412.810791:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 200 00000100:00100000:1.0:1788359412.810803:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+20:12398:x1875230420197120:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788359412.810908:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.810930:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 20 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.810941:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.810995:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 20 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.811012:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 20 pid: 10096 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.811027:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7797100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445415040:192.168.202.52@tcp:104: 00000100:00100000:1.0:1788359412.811128:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359412.819749:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359412.820166:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197248 00000100:00100000:1.0:1788359412.820180:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197248 00010000:00010000:1.0:1788359412.820236:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 21 pid: 10096 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.820292:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 90 00000100:00100000:1.0:1788359412.820304:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:2405:x1875230420197248:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359412.820324:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359412.820333:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 21 pid: 10096 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820350:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 21 pid: 10096 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820378:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.820385:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820409:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820418:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820443:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359412.820527:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:2405:x1875230420197248:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 225us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.820536:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 90 00010000:00010000:1.0:1788359412.820723:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf16c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e710f expref: 20 pid: 10096 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.820739:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7797100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445415040:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359412.820764:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820774:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820780:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820836:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820843:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820850:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820861:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359412.820867:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820875:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820896:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.820900:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788359412.820904:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.820910:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.820972:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12398:x1875230420197120:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 Request processed in 10172us (10591us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788359412.820981:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 200 00000100:00100000:1.0:1788359412.824264:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.824598:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197376 00000100:00100000:3.0:1788359412.824612:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197376 00000100:00100000:3.0:1788359412.824686:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:3.0:1788359412.824698:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420197376:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788359412.824761:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.824788:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.824798:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359412.824803:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359412.824808:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.824856:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.824874:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 8 pid: 8430 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359412.824905:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8882:1875230445415168:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359412.825012:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacc668e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788359412.833392:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8882:1875230445415168:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359412.833435:0:8882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.837835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.844093:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197504 00000100:00100000:3.0:1788359412.844118:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197504 00010000:00010000:3.0:1788359412.844180:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 9 pid: 8430 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359412.844245:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 91 00000100:00100000:3.0:1788359412.844257:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420197504:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359412.844280:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359412.844316:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 9 pid: 8430 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.844335:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 9 pid: 8430 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.844368:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d03d73f/0x49dd053b5feaf196 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e712b expref: 9 pid: 8430 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.844390:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359412.844396:0:10335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359412.844404:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.844416:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.844686:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359412.844786:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420197504:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 530us (6964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.844795:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 91 00010000:00010000:1.0:1788359412.847819:0:8882:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847847:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847898:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847921:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847930:0:8882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847937:0:8882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359412.847943:0:8882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847952:0:8882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847974:0:8882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.847982:0:8882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf1b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.848177:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420197376:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 Request processed in 23474us (23922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.848189:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:0.0:1788359412.855777:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359412.864838:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197760 00000100:00100000:2.0:1788359412.864862:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197760 00000100:00100000:2.0:1788359412.864972:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 201 00000100:00100000:2.0:1788359412.864985:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12398:x1875230420197760:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788359412.865109:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.865133:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 19 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.865144:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.865211:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 19 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.865229:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 19 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.865249:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415296:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359412.865734:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359412.872821:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.872898:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420197888 00000100:00100000:3.0:1788359412.872911:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420197888 00010000:00010000:3.0:1788359412.872963:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359412.873014:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00100000:3.0:1788359412.873026:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:2405:x1875230420197888:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359412.873047:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359412.873055:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.873072:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.873099:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.873106:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.873157:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf000 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70b4 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.873177:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415296:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359412.873219:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.873230:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.874931:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.875066:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359412.875111:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875118:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875361:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875381:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875405:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875611:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.875630:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.875651:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415424:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359412.879980:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788359412.880238:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:2405:x1875230420197888:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 7204us (7423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.880253:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 92 00000100:00100000:3.0:1788359412.885988:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.886137:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415424:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359412.886174:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.886244:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420198016 00000100:00100000:1.0:1788359412.886253:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420198016 00010000:00010000:1.0:1788359412.886307:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.886353:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 93 00000100:00100000:1.0:1788359412.886364:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+20:2405:x1875230420198016:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359412.886383:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359412.886392:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886407:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886448:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8000/0x49dd053b5feaf17a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7116 expref: 20 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886464:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:1.0:1788359412.886470:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886481:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886491:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359412.886703:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359412.886715:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.886724:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359412.886779:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+19:2405:x1875230420198016:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 416us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359412.886787:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 93 00000001:00080000:2.0:1788359412.886919:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788359412.887101:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788359412.887152:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788359412.887274:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875230445415552:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788359412.887345:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359412.887395:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445415552 00000100:00100000:2.0:1788359412.887402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445415552 00000100:00100000:2.0:1788359412.887449:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788359412.887458:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875230445415552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788359412.887584:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6515:x1875230445415552:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359412.887592:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788359412.887621:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359412.887648:0:6515:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788359412.887654:0:6515:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0e9c81da300, transno 4294967316 00000100:00100000:2.0:1788359412.887668:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875230445415552:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788359412.887882:0:6515:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788359412.887942:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875230445415680:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788359412.887987:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359412.888004:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359412.888587:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445415680 00000100:00100000:0.0:1788359412.888597:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445415680 00000100:00100000:0.0:1788359412.888644:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788359412.888654:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6515:x1875230445415680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788359412.888804:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6515:x1875230445415680:12345-0@lo:1000:mdt00_000.0 Request processed in 151us (816us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788359412.888811:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788359412.888854:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c81d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6515:1875230445415680:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788359412.888910:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888922:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888931:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888938:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.888943:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888951:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888970:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:0.0:1788359412.888982:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359412.888988:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.888994:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf1c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889023:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889029:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889035:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889040:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359412.889043:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889049:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889057:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:0.0:1788359412.889060:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359412.889062:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889067:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf0f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889097:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889125:0:6515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 22 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889134:0:6515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889171:0:6515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 22 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.889188:0:6515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 22 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.889204:0:6515:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415808:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359412.889394:0:6515:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359412.897757:0:6515:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6515:1875230445415808:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359412.897806:0:6515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359412.899286:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359412.899828:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420198144 00000100:00100000:3.0:1788359412.899842:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420198144 00010000:00010000:3.0:1788359412.899934:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 23 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359412.899991:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 94 00000100:00100000:3.0:1788359412.900003:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+23:2404:x1875230420198144:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359412.900024:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359412.900033:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 23 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900051:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 23 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900079:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e70fa expref: 23 pid: 7748 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900098:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:3.0:1788359412.900105:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900117:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900146:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359412.900187:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359412.900346:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2404:x1875230420198144:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 345us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.900355:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 94 00010000:00010000:2.0:1788359412.900627:0:6515:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900639:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900658:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900665:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900671:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900678:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359412.900683:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900690:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900703:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359412.900706:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359412.900721:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900729:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf1c7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900744:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900749:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900755:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900760:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359412.900762:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900768:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900776:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0ead14aad00) 00010000:00010000:2.0:1788359412.900778:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359412.900780:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.900786:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359412.901007:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12398:x1875230420197760:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 36023us (45245us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788359412.901016:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 201 00000020:00080000:2.0:1788359412.901027:0:6515:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788359412.903406:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359412.903420:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788359412.906064:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788359412.906093:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359412.910323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359412.910562:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420198400 00000100:00100000:0.0:1788359412.910580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420198400 00000100:00100000:0.0:1788359412.910657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:0.0:1788359412.910671:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12398:x1875230420198400:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788359412.911080:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788359412.911130:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788359412.911172:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911222:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911238:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911248:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911255:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911262:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359412.911288:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788359412.911424:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d92c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:12398:x1875230420198400:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 755us (1116us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788359412.911434:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000020:00080000:0.0:1788359412.911439:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788359412.911457:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359412.911466:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.911486:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359412.911491:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.911522:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.911546:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:2.0:1788359412.911550:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788359412.911555:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.911560:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf1ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359412.911572:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359412.911574:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359412.911575:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359412.925292:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359412.925321:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445415936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359412.925407:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359412.925699:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445415936 00000100:00100000:3.0:1788359412.925710:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445415936 00000100:00100000:3.0:1788359412.925777:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788359412.925787:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445415936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359412.925830:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788359412.925955:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445415936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359412.925963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788359412.926297:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445415936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359413.116946:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788359413.156683:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359413.156696:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359413.156760:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788359413.156767:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788359413.287170:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.287228:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420198656 00000100:00100000:2.0:1788359413.287241:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420198656 00000100:00100000:2.0:1788359413.287328:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 202 00000100:00100000:2.0:1788359413.287339:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+23:12408:x1875230420198656:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359413.287372:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359413.287417:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf1d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7132 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.287584:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.287603:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.287617:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359413.287631:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788359413.287774:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7132 expref: 26 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.287798:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7132 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.287807:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359413.287811:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788359413.287815:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eba00, rc 0) 00000100:00100000:2.0:1788359413.287904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12408:x1875230420198656:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 566us (748us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788359413.287912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 202 00000100:00100000:0.0:1788359413.291556:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359413.291724:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420198784 00000100:00100000:1.0:1788359413.291738:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420198784 00000100:00100000:1.0:1788359413.291828:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 203 00000100:00100000:1.0:1788359413.291842:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12408:x1875230420198784:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:1.0:1788359413.291962:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.291984:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292000:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292021:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292029:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292037:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292153:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292161:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292169:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359413.292239:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292274:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292281:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292289:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292296:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359413.292301:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292309:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292325:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:1.0:1788359413.292329:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359413.292334:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292341:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf1ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292358:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292365:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292372:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292385:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359413.292389:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292397:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292405:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0e9c6398300) 00010000:00010000:1.0:1788359413.292407:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359413.292410:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292416:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf1f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292435:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292441:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292448:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292452:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359413.292456:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292461:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292733:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6398f00) 00010000:00010000:1.0:1788359413.292735:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359413.292739:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.292744:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf1f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.292902:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12408:x1875230420198784:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 1061us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359413.292912:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 203 00000100:00100000:2.0:1788359413.340172:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.340447:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199040 00000100:00100000:0.0:1788359413.340457:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199040 00000100:00100000:0.0:1788359413.340905:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 204 00000100:00100000:0.0:1788359413.340918:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c81da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12411:x1875230420199040:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359413.340948:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359413.340970:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf1ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7139 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341045:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341060:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341071:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341087:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341094:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341101:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341213:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341222:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341229:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359413.341240:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788359413.341323:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341331:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341337:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341344:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359413.341347:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341356:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341367:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359413.341370:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359413.341374:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341379:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feaf206 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341391:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341396:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341402:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341407:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359413.341422:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341429:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341440:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0e9c6341200) 00010000:00010000:0.0:1788359413.341443:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359413.341447:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341452:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf20d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341680:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf1ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 28 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341698:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 27 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.341706:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:0.0:1788359413.341708:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359413.341711:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8800, rc 0) 00000100:00100000:0.0:1788359413.341779:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c81da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12411:x1875230420199040:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 865us (1617us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788359413.341787:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 204 00000100:00100000:3.0:1788359413.351142:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.351206:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199168 00000100:00100000:2.0:1788359413.351218:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199168 00000100:00100000:2.0:1788359413.351290:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 205 00000100:00100000:2.0:1788359413.351298:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12411:x1875230420199168:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:2.0:1788359413.351364:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351378:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351387:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351418:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351423:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351427:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351431:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.351434:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351439:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351446:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.351448:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359413.351458:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.351462:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.351548:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12411:x1875230420199168:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 252us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359413.351554:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 205 00000100:00100000:2.0:1788359413.358222:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.358313:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199424 00000100:00100000:0.0:1788359413.358324:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199424 00000100:00100000:0.0:1788359413.361161:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:0.0:1788359413.361177:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12411:x1875230420199424:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359413.361421:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+28:12411:x1875230420199424:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 248us (3207us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788359413.361431:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:1.0:1788359413.400234:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.400340:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199680 00000100:00100000:3.0:1788359413.400351:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199680 00000100:00100000:3.0:1788359413.400411:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 206 00000100:00100000:3.0:1788359413.400422:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+28:11944:x1875230420199680:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359413.400447:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359413.400467:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf229 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7140 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.400625:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.400641:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.400650:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.400685:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 29 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.400699:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 29 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.400713:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445416064:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359413.400811:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359413.406202:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445416064:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359413.406641:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.406931:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359413.406965:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199808 00000100:00100000:1.0:1788359413.406973:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199808 00010000:00010000:1.0:1788359413.407017:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 30 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.407055:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 95 00000100:00100000:1.0:1788359413.407066:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+30:2404:x1875230420199808:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359413.407095:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359413.407103:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 30 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407116:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 30 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407154:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feaf214 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7139 expref: 30 pid: 6515 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407168:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:1.0:1788359413.407173:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407184:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407192:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407217:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359413.407267:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+29:2404:x1875230420199808:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 203us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359413.407275:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 95 00010000:00010000:1.0:1788359413.407368:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.407376:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359413.407394:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788359413.408266:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf229 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 30 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.408287:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 29 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.408305:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:1.0:1788359413.408308:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788359413.408311:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:1.0:1788359413.408354:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+29:11944:x1875230420199680:12345-192.168.202.52@tcp:101:bash.0 Request processed in 7934us (8128us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788359413.408362:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 206 00000100:00100000:1.0:1788359413.427936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.428458:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420199936 00000100:00100000:0.0:1788359413.428475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420199936 00000100:00100000:0.0:1788359413.428579:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 207 00000100:00100000:0.0:1788359413.428665:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+29:11944:x1875230420199936:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359413.428696:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359413.428720:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf23e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7147 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428760:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428774:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428786:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428911:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8c00/0x49dd053b5feaf23e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7147 expref: 31 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428939:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7147 expref: 30 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.428948:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:0.0:1788359413.430735:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359413.430761:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8200, rc 0) 00000100:00100000:0.0:1788359413.430860:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11944:x1875230420199936:12345-192.168.202.52@tcp:101:bash.0 Request processed in 2269us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359413.430870:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 207 00000100:00100000:1.0:1788359413.436893:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445416192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359413.437010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359413.437083:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445416192 00000100:00100000:3.0:1788359413.437096:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445416192 00000100:00100000:3.0:1788359413.437158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788359413.437168:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445416192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359413.437336:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788359413.437461:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359413.437535:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200192 00000100:00100000:1.0:1788359413.437543:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200192 00000100:00100000:1.0:1788359413.437607:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 208 00000100:00100000:1.0:1788359413.437616:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:11944:x1875230420200192:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:1.0:1788359413.437932:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.437955:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.437970:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788359413.438031:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788359413.438064:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b16aa80 reply state 00000000b734e603 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.438099:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.438108:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:1.0:1788359413.438112:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359413.438117:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359413.438127:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445416192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 957us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.438138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000001:00080000:1.0:1788359413.438162:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788359413.438277:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+34:11944:x1875230420200192:12345-192.168.202.52@tcp:36:bash.0 Request processed in 660us (817us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788359413.438285:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 208 00000020:00080000:1.0:1788359413.438291:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788359413.439903:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445416192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359413.446935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.447476:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200320 00000100:00100000:2.0:1788359413.447490:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200320 00000100:00100000:2.0:1788359413.447582:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 209 00000100:00100000:2.0:1788359413.447607:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+34:11944:x1875230420200320:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359413.447637:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359413.447662:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf253 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e714e expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.447725:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e714e expref: 35 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.447742:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf253 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e714e expref: 35 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.447763:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.447767:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359413.447770:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eac00, rc 0) 00000100:00100000:2.0:1788359413.447854:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+35:11944:x1875230420200320:12345-192.168.202.52@tcp:101:bash.0 Request processed in 261us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359413.447889:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 209 00000100:00100000:1.0:1788359413.458865:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.458998:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200448 00000100:00100000:0.0:1788359413.459013:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200448 00000100:00100000:0.0:1788359413.459092:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:0.0:1788359413.459104:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:11944:x1875230420200448:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359413.459130:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359413.459158:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7155 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359413.459196:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9832f3, atime: 0x6a9832f2, ctime: 0x6a9832f3, blocks: 0x8 00010000:00010000:0.0:1788359413.459225:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:0.0:1788359413.459231:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359413.459241:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.459262:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.459278:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8c00, rc 0) 00000100:00100000:0.0:1788359413.459617:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:11944:x1875230420200448:12345-192.168.202.52@tcp:101:bash.0 Request processed in 513us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359413.459627:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:1.0:1788359413.471236:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.471329:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200576 00000100:00100000:2.0:1788359413.471401:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200576 00002000:00010000:2.0:1788359413.471449:0:8438:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788359413.471466:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c755dc00 with x1875230420200576 ext(0->18446744073709551615) 00002000:00010000:2.0:1788359413.471478:0:8438:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c755dc00. 00000100:00100000:2.0:1788359413.471551:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:2.0:1788359413.471564:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420200576:12345-192.168.202.52@tcp:10:bash.0 00002000:00010000:2.0:1788359413.472255:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788359413.472262:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788359411 -> 1788359413 00002000:00010000:2.0:1788359413.472265:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788359410 -> 1788359410 00002000:00010000:2.0:1788359413.472267:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788359411 -> 1788359413 00002000:00010000:2.0:1788359413.472270:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788359413.472370:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420200576:12345-192.168.202.52@tcp:10:bash.0 Request processed in 808us (1150us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788359413.472380:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00002000:00010000:2.0:1788359413.472384:0:8438:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788359413.472387:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c755dc00 with x1875230420200576 ext(0->18446744073709551615) 00002000:00010000:2.0:1788359413.472393:0:8438:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0e9c755dc00. 00000100:00100000:1.0:1788359413.536258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.538933:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200704 00000100:00100000:0.0:1788359413.538980:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200704 00000100:00100000:2.0:1788359413.539192:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 210 00000100:00100000:2.0:1788359413.539205:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+35:12425:x1875230420200704:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:2.0:1788359413.539308:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.539329:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.539352:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.539892:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.539904:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.539914:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540026:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540037:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540044:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359413.540102:0:6515:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540115:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540122:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540130:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540149:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.540154:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540162:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540176:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359413.540179:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.540185:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540191:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf261 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540207:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540213:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540219:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540225:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.540228:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540234:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540252:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd500) 00010000:00010000:2.0:1788359413.540255:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.540258:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540264:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540281:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540288:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540294:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540300:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.540303:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540308:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540315:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.540318:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.540321:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.540327:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf26f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.541318:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+35:12425:x1875230420200704:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 2105us (5066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359413.541333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 210 00000100:00100000:1.0:1788359413.577079:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.577208:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420200960 00000100:00100000:3.0:1788359413.577222:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420200960 00000100:00100000:3.0:1788359413.577311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 211 00000100:00100000:3.0:1788359413.577324:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+35:12428:x1875230420200960:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359413.577355:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359413.577395:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf276 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e715c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577536:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577556:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577570:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577590:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577598:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577605:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577787:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf28b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577799:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577807:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf28b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359413.577819:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788359413.577942:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577951:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577957:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577964:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359413.577969:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577977:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.577992:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359413.577996:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359413.578001:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578020:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf27d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578038:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578045:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578052:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578057:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359413.578061:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578068:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578076:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2900) 00010000:00010000:3.0:1788359413.578079:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359413.578082:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578089:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf284 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578141:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf276 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e715c expref: 38 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578158:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf28b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e715c expref: 37 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.578174:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:3.0:1788359413.578177:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788359413.578180:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6800, rc 0) 00000100:00100000:3.0:1788359413.578262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12428:x1875230420200960:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 940us (1200us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788359413.578270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 211 00000100:00100000:1.0:1788359413.582993:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.583121:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201088 00000100:00100000:2.0:1788359413.583135:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201088 00000100:00100000:2.0:1788359413.583218:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 212 00000100:00100000:2.0:1788359413.583230:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c755ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12428:x1875230420201088:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:2.0:1788359413.583327:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.583364:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 37 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.583377:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.583435:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 37 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.583452:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 37 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.583472:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445416320:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359413.583635:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359413.595697:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445416320:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359413.595749:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.597374:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.597490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201344 00000100:00100000:3.0:1788359413.597552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201344 00000100:00100000:3.0:1788359413.597620:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:3.0:1788359413.597632:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:6173:x1875230420201344:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788359413.598053:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+39:6173:x1875230420201344:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 423us (690us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788359413.598062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:0.0:1788359413.605734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.610585:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201472 00000100:00100000:3.0:1788359413.610609:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201472 00010000:00010000:3.0:1788359413.610687:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 39 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.610939:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 96 00000100:00100000:3.0:1788359413.610952:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+39:2404:x1875230420201472:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359413.611124:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359413.611134:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 39 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611151:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 39 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611210:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf230 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7140 expref: 39 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611232:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:3.0:1788359413.611239:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611250:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611259:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.611340:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359413.611428:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:2404:x1875230420201472:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 478us (5714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.611438:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 96 00010000:00010000:2.0:1788359413.615244:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615269:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615336:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615345:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615353:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615360:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.615365:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615374:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615400:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.615405:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359413.615412:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.615419:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf299 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.615656:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c755ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12428:x1875230420201088:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 32421us (32670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359413.615685:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 212 00000100:00100000:0.0:1788359413.627020:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.627147:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201728 00000100:00100000:2.0:1788359413.627161:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201728 00000100:00100000:2.0:1788359413.627243:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:2.0:1788359413.627255:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+37:12428:x1875230420201728:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359413.627598:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+38:12428:x1875230420201728:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 343us (589us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788359413.627607:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:1.0:1788359413.692680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359413.693304:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.693530:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201984 00000100:00100000:3.0:1788359413.693543:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201984 00000100:00100000:3.0:1788359413.693619:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:3.0:1788359413.693632:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420201984:12345-192.168.202.52@tcp:16:kworker.0 00000100:00100000:0.0:1788359413.693905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420201856 00000100:00100000:0.0:1788359413.693910:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420201856 00002000:00100000:0.0:1788359413.693949:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffffa0ead28ded80 x1875230420201856/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:739/0 lens 496/0 e 0 to 0 dl 1788359424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359413.693963:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ead28ded80 with x1875230420201856 ext(0->7) 00002000:00010000:0.0:1788359413.693971:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0ead28ded80 00000100:00100000:0.0:1788359413.694005:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:0.0:1788359413.694014:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2405:x1875230420201856:12345-192.168.202.52@tcp:4:bash.0 00000001:00080000:2.0:1788359413.696044:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:2.0:1788359413.696056:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:3.0:1788359413.696245:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420201984:12345-192.168.202.52@tcp:16:kworker.0 Request processed in 2610us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.696257:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:0.0:1788359413.696482:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420201856:12345-192.168.202.52@tcp:4:bash.0 Request processed in 2467us (3815us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788359413.696583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00002000:00100000:0.0:1788359413.696597:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffffa0ead28ded80 x1875230420201856/t4294967320(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:739/0 lens 496/448 e 0 to 0 dl 1788359424 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359413.696609:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ead28ded80 with x1875230420201856 ext(0->7) 00002000:00010000:0.0:1788359413.696615:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0ead28ded80 00000100:00100000:1.0:1788359413.730719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.730816:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420202240 00000100:00100000:2.0:1788359413.730827:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420202240 00000100:00100000:2.0:1788359413.730920:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 213 00000100:00100000:2.0:1788359413.730931:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+38:12440:x1875230420202240:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:2.0:1788359413.730961:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359413.730988:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7163 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731081:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731102:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731116:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731158:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731165:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731273:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731282:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731289:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359413.731298:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788359413.731367:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731373:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731379:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731384:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.731388:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731394:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731414:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359413.731417:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.731421:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731427:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731440:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731445:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731450:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731454:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.731456:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731461:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731467:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:2.0:1788359413.731469:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.731471:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731476:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731567:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7163 expref: 41 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731580:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7163 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.731587:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.731590:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359413.731592:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ebc00, rc 0) 00000100:00100000:2.0:1788359413.731653:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12440:x1875230420202240:12345-192.168.202.52@tcp:101:cat.0 Request processed in 725us (945us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788359413.731660:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 213 00000100:00100000:1.0:1788359413.742652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.742746:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420202496 00000100:00100000:0.0:1788359413.742756:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420202496 00000100:00100000:0.0:1788359413.742812:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:0.0:1788359413.742820:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+40:12440:x1875230420202496:12345-192.168.202.52@tcp:35:cat.0 00000100:00100000:0.0:1788359413.743237:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+41:12440:x1875230420202496:12345-192.168.202.52@tcp:35:cat.0 Request processed in 417us (594us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788359413.743243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:1.0:1788359413.762802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.762865:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420202752 00000100:00100000:2.0:1788359413.762886:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420202752 00000100:00100000:2.0:1788359413.762948:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 214 00000100:00100000:2.0:1788359413.762959:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+41:12441:x1875230420202752:12345-192.168.202.52@tcp:36:rm.0 00010000:00010000:2.0:1788359413.763018:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788359413.763059:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf253 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e714e expref: 41 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763081:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7163 expref: 40 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763092:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf28b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e715c expref: 39 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763129:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7147 expref: 38 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763139:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.763143:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359413.763163:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763175:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763183:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763196:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763202:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763209:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763290:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763299:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763305:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359413.763654:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788359413.763665:0:7748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445734169113ns, next at 446734166818ns, rc = 0 00010000:00010000:2.0:1788359413.763722:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763732:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763740:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763747:0:7748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763753:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763759:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763782:0:7748:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788359413.763802:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763809:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763819:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763826:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.763835:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763842:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763851:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:2.0:1788359413.763854:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788359413.763858:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763865:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2d1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763892:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763899:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763904:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763910:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.763913:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763919:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763927:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359413.763929:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.763939:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763945:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359413.763956:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084df1a1c reply state 0000000084c06d85 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763967:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.763973:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:2.0:1788359413.763976:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359413.763978:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359413.764050:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+39:12441:x1875230420202752:12345-192.168.202.52@tcp:36:rm.0 Request processed in 1092us (1253us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788359413.764058:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 214 00010000:00010000:1.0:1788359413.766077:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359413.766091:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.766102:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359413.766122:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.766131:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.766148:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:1.0:1788359413.766151:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788359413.766156:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.766161:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf2d8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.766177:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359413.766179:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359413.766181:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359413.809628:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.809688:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203008 00000100:00100000:2.0:1788359413.809699:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203008 00000100:00100000:2.0:1788359413.809762:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 215 00000100:00100000:2.0:1788359413.809773:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+39:12447:x1875230420203008:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359413.809799:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359413.809820:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2df lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e716a expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809927:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809943:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809979:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809988:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809994:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.809998:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788359413.810247:0:10096:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788359413.810342:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810348:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810352:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810375:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810381:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810388:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810395:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359413.810405:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810413:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810425:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359413.810428:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359413.810432:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810439:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf2e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359413.810453:0:10096:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000938686f1 reply state 0000000093f2145f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810464:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810470:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:2.0:1788359413.810473:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359413.810475:0:10096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788359413.810547:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf2df lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 42 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810562:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 41 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.810579:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:2.0:1788359413.810581:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359413.810590:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eac00, rc 0) 00000100:00100000:2.0:1788359413.810657:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+42:12447:x1875230420203008:12345-192.168.202.52@tcp:101:bash.0 Request processed in 886us (1038us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788359413.810665:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 215 00000100:00100000:1.0:1788359413.813772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.813939:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203136 00000100:00100000:3.0:1788359413.813950:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203136 00000100:00100000:3.0:1788359413.814004:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:3.0:1788359413.814024:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420203136:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359413.814042:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359413.814063:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7171 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788359413.814087:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788359413.814105:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1788359413.814109:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359413.814118:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.814137:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.814150:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:3.0:1788359413.814201:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420203136:12345-192.168.202.52@tcp:101:bash.0 Request processed in 178us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.814207:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:1.0:1788359413.816628:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.816745:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203264 00000100:00100000:3.0:1788359413.816753:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203264 00000100:00100000:3.0:1788359413.816797:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:3.0:1788359413.816804:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:12447:x1875230420203264:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359413.816818:0:8882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359413.816830:0:8882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7178 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.816867:0:8882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.816873:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359413.816888:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359413.816893:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 9 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.816931:0:8882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.816945:0:8882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.816955:0:8882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445416448:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359413.817039:0:8882:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359413.818606:0:8882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8882:1875230445416448:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359413.818638:0:8882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 9 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.818655:0:8882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359413.818739:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+9:12447:x1875230420203264:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1934us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.818747:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:1.0:1788359413.819559:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.819845:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203392 00000100:00100000:0.0:1788359413.819853:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203392 00010000:00010000:0.0:1788359413.819894:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359413.819976:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:0.0:1788359413.819986:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2405:x1875230420203392:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359413.819999:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359413.820019:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.820033:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.820055:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4823e40/0x49dd053b5feaf302 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7171 expref: 9 pid: 8431 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.820070:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359413.820074:0:7465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359413.820080:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.820087:0:7465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.820112:0:7465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359413.820131:0:7465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875230445416576:192.168.202.52@tcp:105: 00000100:00100000:0.0:1788359413.820192:0:7465:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359413.822483:0:7465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7465:1875230445416576:192.168.202.52@tcp:105: 00010000:00010000:0.0:1788359413.822869:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359413.822976:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420203392:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 2982us (3410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359413.822987:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 97 00000100:00100000:1.0:1788359413.823038:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.823104:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203648 00000100:00100000:0.0:1788359413.823111:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203648 00000100:00100000:0.0:1788359413.823152:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:0.0:1788359413.823162:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+42:12447:x1875230420203648:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:0.0:1788359413.823399:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+43:12447:x1875230420203648:12345-192.168.202.52@tcp:35:bash.0 Request processed in 238us (361us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788359413.823406:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:1.0:1788359413.950941:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.951026:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420203776 00000100:00100000:3.0:1788359413.951035:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420203776 00000100:00100000:3.0:1788359413.951114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 216 00000100:00100000:3.0:1788359413.951121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+43:12463:x1875230420203776:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359413.951141:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359413.951160:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e717f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951233:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951247:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951259:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359413.951297:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788359413.951300:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359413.951316:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951334:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e717f expref: 45 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951347:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e717f expref: 44 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.951353:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359413.951355:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359413.951369:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:3.0:1788359413.951418:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+44:12463:x1875230420203776:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 298us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.951430:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 216 00000100:00100000:2.0:1788359413.954336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.954490:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204032 00000100:00100000:0.0:1788359413.954545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204032 00000100:00100000:0.0:1788359413.954599:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 217 00000100:00100000:0.0:1788359413.954609:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+44:12463:x1875230420204032:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359413.954632:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359413.954651:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf31e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7186 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.954738:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.954762:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.954771:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359413.954780:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788359413.954862:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf31e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7186 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.954885:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7186 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.954892:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:0.0:1788359413.954894:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359413.954897:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9200, rc 0) 00000100:00100000:0.0:1788359413.954954:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+46:12463:x1875230420204032:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 347us (628us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788359413.954959:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 217 00000100:00100000:1.0:1788359413.963479:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.963551:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204288 00000100:00100000:1.0:1788359413.963559:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359413.963561:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204288 00000100:00100000:0.0:1788359413.963613:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 218 00000100:00100000:0.0:1788359413.963623:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+46:12463:x1875230420204288:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359413.963647:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788359413.963656:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204416 00000100:00100000:2.0:1788359413.963660:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204416 00010000:00010000:0.0:1788359413.963667:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e718d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.963697:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:2.0:1788359413.963704:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+48:2405:x1875230420204416:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359413.963715:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359413.963733:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7186 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.963747:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:2.0:1788359413.963752:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359413.963779:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.963792:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.963800:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+47:2405:x1875230420204416:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 97us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1788359413.963802:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.963807:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 15 00000004:00200000:0.0:1788359413.963814:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788359413.964010:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9000/0x49dd053b5feaf333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e718d expref: 48 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.964025:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e718d expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359413.964033:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:0.0:1788359413.964036:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788359413.964038:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8a00, rc 0) 00000100:00100000:0.0:1788359413.964093:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+47:12463:x1875230420204288:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 471us (621us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788359413.964100:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 218 00000100:00100000:1.0:1788359413.968486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.968642:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204544 00000100:00100000:3.0:1788359413.968653:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204544 00000100:00100000:3.0:1788359413.968706:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:3.0:1788359413.968716:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c807d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420204544:12345-192.168.202.52@tcp:1:lfs.0 00010000:00010000:3.0:1788359413.968761:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.968780:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.968789:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359413.968794:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359413.968798:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.968833:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.968848:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 8 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.968862:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875230445416704:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359413.968959:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359413.972773:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875230445416704:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359413.972804:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.977796:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359413.977849:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204672 00000100:00100000:2.0:1788359413.977859:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204672 00002000:00100000:2.0:1788359413.977946:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffffa0e9c8124000 x1875230420204672/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:739/0 lens 504/0 e 0 to 0 dl 1788359424 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359413.977955:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c8124000 with x1875230420204672 ext(0->8) 00010000:00010000:2.0:1788359413.977962:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 9 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.977975:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 9 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359413.977988:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c8124000 00000100:00100000:2.0:1788359413.978013:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:2.0:1788359413.978020:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420204672:12345-192.168.202.52@tcp:4:lfs.0 00000100:00100000:2.0:1788359413.978706:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2404:x1875230420204672:12345-192.168.202.52@tcp:4:lfs.0 Request processed in 683us (917us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788359413.978715:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 3 00002000:00100000:2.0:1788359413.978722:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffffa0e9c8124000 x1875230420204672/t4294967309(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:739/0 lens 504/448 e 0 to 0 dl 1788359424 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359413.978731:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0e9c8124000 with x1875230420204672 ext(0->8) 00010000:00010000:2.0:1788359413.978736:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.978748:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359413.978956:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0e9c8124000 00000100:00100000:2.0:1788359413.981004:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.981053:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420204800 00000100:00100000:3.0:1788359413.981062:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420204800 00010000:00010000:3.0:1788359413.981096:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.981185:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 98 00000100:00100000:3.0:1788359413.981196:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2402:x1875230420204800:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359413.981210:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788359413.981236:0:6500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788359413.981238:0:6500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788359413 00002000:00010000:3.0:1788359413.981241:0:6500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788359413 00002000:00010000:3.0:1788359413.981243:0:6500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788359413 00002000:00010000:3.0:1788359413.981245:0:6500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788359413.981250:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.981263:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.981285:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031e10ec5/0x49dd053b5feaf309 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7178 expref: 11 pid: 8882 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.981318:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359413.981322:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359413.981328:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.981337:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.981364:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359413.981393:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981406:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.981416:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2402:x1875230420204800:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 221us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359413.981424:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 98 00010000:00010000:2.0:1788359413.981430:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981443:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981449:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981454:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359413.981457:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981464:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981472:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359413.981477:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcffa094/0x49dd053b5feaf348 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359413.981551:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c807d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420204544:12345-192.168.202.52@tcp:1:lfs.0 Request processed in 12837us (13074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359413.981557:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 70 00000100:00100000:0.0:1788359413.983866:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359413.983964:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205056 00000100:00100000:3.0:1788359413.983974:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205056 00000100:00100000:3.0:1788359413.984052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:3.0:1788359413.984062:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d91050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+47:12463:x1875230420205056:12345-192.168.202.52@tcp:35:lfs.0 00000004:00010000:3.0:1788359413.984119:0:6519:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e718d expref: 47 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359413.984307:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1788359413.984335:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788359413.984768:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1788359413.984801:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.984814:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 51 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.984834:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.984865:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 51 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.985728:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 51 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359413.985747:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875230445416832:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359413.985832:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396480 going to sleep for 11 seconds 00000100:00100000:1.0:1788359413.987806:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6519:1875230445416832:192.168.202.52@tcp:104: 00010000:00010000:1.0:1788359413.987834:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359413.989143:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359413.989263:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205184 00000100:00100000:1.0:1788359413.989272:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205184 00010000:00010000:1.0:1788359413.989306:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 52 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.989340:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 99 00000100:00100000:1.0:1788359413.989349:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+52:2404:x1875230420205184:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359413.989363:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359413.989370:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 52 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989445:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 52 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989466:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf2f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e716a expref: 52 pid: 10096 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989481:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:1.0:1788359413.989486:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989618:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989627:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.989652:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359413.989718:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+51:2404:x1875230420205184:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 370us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359413.989725:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 99 00010000:00010000:3.0:1788359413.989922:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359413.989930:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359413.990031:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788359413.990134:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788359413.990225:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445416960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788359413.990268:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359413.990292:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359413.990351:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445416960 00000100:00100000:0.0:1788359413.990356:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445416960 00000100:00100000:0.0:1788359413.990401:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788359413.990408:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875230445416960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788359413.990522:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875230445416960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359413.990529:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788359413.992304:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffad0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445416960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788359413.992460:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788359413.993791:0:6519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445417088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788359413.993852:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359413.993979:0:6519:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359413.996164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445417088 00000100:00100000:3.0:1788359413.996234:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445417088 00000100:00100000:0.0:1788359413.996430:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788359413.996444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6519:x1875230445417088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788359413.996925:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6519:x1875230445417088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 484us (3070us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788359413.996933:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788359413.997005:0:6519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6519:1875230445417088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788359413.997064:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788359413.997109:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997119:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997127:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997133:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359413.997137:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997145:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997159:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:1.0:1788359413.997163:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788359413.997167:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359413.997250:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf34f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788359413.997346:0:6519:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788359413.997460:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788359413.997470:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 445967974405ns, next at 446967972296ns, rc = 0 00000001:00080000:1.0:1788359413.997477:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788359413.997718:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0eafaddd200) 00010000:00010000:1.0:1788359413.997721:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788359413.997728:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf33a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e718d expref: 55 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359413.997865:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d91050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12463:x1875230420205056:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 13804us (14006us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788359413.997885:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 56 00000020:00080000:1.0:1788359413.997889:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788359413.999957:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.000089:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205312 00000100:00100000:3.0:1788359414.000098:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205312 00000100:00100000:3.0:1788359414.000190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 219 00000100:00100000:3.0:1788359414.000199:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+54:12463:x1875230420205312:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359414.000234:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359414.000256:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf356 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7194 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.000307:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf356 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7194 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.000321:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf356 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7194 expref: 55 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.000337:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.000340:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359414.000343:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359414.000402:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+55:12463:x1875230420205312:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 204us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.000409:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 219 00000100:00100000:0.0:1788359414.002906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.003054:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205568 00000100:00100000:2.0:1788359414.003063:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205568 00000100:00100000:2.0:1788359414.003162:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:2.0:1788359414.003194:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+55:12463:x1875230420205568:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359414.003428:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12463:x1875230420205568:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 245us (530us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788359414.003436:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00080000:3.0:1788359414.003831:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359414.080376:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359414.080446:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205696 00000100:00100000:1.0:1788359414.080457:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205696 00000100:00100000:1.0:1788359414.080578:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 220 00000100:00100000:1.0:1788359414.080589:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12473:x1875230420205696:12345-192.168.202.52@tcp:34:lfs.0 00010000:00010000:1.0:1788359414.080671:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080692:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080707:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080734:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080740:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080744:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080826:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080834:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080840:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359414.080905:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080918:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080925:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080932:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080939:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359414.080942:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080956:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080968:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:1.0:1788359414.080970:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359414.080975:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080980:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf35d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080993:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.080999:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081005:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081010:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359414.081013:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081019:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081026:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:1.0:1788359414.081028:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359414.081031:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081047:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf364 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081057:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081063:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081069:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081074:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359414.081077:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081083:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081090:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:1.0:1788359414.081092:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359414.081095:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.081100:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf36b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359414.081179:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12473:x1875230420205696:12345-192.168.202.52@tcp:34:lfs.0 Request processed in 591us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359414.081187:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 220 00010000:00010000:2.0:1788359414.140909:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359414.141460:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359414.141656:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420205952 00000100:00100000:0.0:1788359414.141666:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420205952 00000100:00100000:0.0:1788359414.141731:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 221 00000100:00100000:0.0:1788359414.141741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+56:12476:x1875230420205952:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359414.141762:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359414.141781:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e719b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141853:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141869:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141895:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141907:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141928:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.141935:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142045:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142053:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142060:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359414.142069:0:6515:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788359414.142150:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142157:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142164:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142170:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359414.142174:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142181:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142202:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359414.142205:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359414.142210:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142215:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf379 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142227:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142233:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142238:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142243:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359414.142246:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142252:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142259:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:0.0:1788359414.142261:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359414.142263:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142268:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142313:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142328:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 58 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.142335:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359414.142337:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359414.142340:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9600, rc 0) 00000100:00100000:0.0:1788359414.142574:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12476:x1875230420205952:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 834us (1120us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788359414.142582:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 221 00000100:00100000:0.0:1788359414.149207:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.150815:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420206080 00000100:00100000:3.0:1788359414.150827:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420206080 00000100:00100000:3.0:1788359414.150948:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 222 00000100:00100000:3.0:1788359414.150960:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12476:x1875230420206080:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:3.0:1788359414.151026:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151040:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151049:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151096:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151101:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151105:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151109:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.151111:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151116:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151134:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.151136:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359414.151140:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.151144:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.151215:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12476:x1875230420206080:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 259us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.151228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 222 00000100:00100000:3.0:1788359414.159845:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359414.159976:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420206336 00000100:00100000:1.0:1788359414.159985:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420206336 00000100:00100000:1.0:1788359414.160035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:1.0:1788359414.160042:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+58:12476:x1875230420206336:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:1.0:1788359414.160256:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12476:x1875230420206336:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 214us (418us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788359414.160264:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:1.0:1788359414.250382:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.250541:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420206592 00000100:00100000:2.0:1788359414.250551:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420206592 00000100:00100000:2.0:1788359414.250608:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 223 00000100:00100000:2.0:1788359414.250616:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12486:x1875230420206592:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359414.250640:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359414.250644:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788359414.250668:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e717f expref: 59 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250688:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:2.0:1788359414.250692:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359414.250704:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf39c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71a2 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250802:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250814:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250822:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250863:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 59 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.250893:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 59 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359414.250907:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417216:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359414.250994:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788359414.262075:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.263234:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420206720 00000100:00100000:3.0:1788359414.263254:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420206720 00010000:00010000:3.0:1788359414.263337:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 60 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.263592:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 100 00000100:00100000:3.0:1788359414.263605:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+60:2405:x1875230420206720:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359414.263626:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359414.263635:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 60 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.263652:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 60 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.263681:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.263689:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.263700:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.263709:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.263733:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359414.263815:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+60:2405:x1875230420206720:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 212us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.263823:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 100 00010000:00010000:2.0:1788359414.268008:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feaf387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e719b expref: 59 pid: 6515 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359414.268036:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417216:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359414.268058:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.268068:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.268073:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359414.268092:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788359414.268212:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf39c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 60 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.268226:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 59 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.268254:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:2.0:1788359414.268257:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788359414.268261:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eac00, rc 0) 00000100:00100000:2.0:1788359414.268329:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12486:x1875230420206592:12345-192.168.202.52@tcp:101:bash.0 Request processed in 17712us (17963us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788359414.268337:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 223 00000100:00100000:1.0:1788359414.281467:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359414.290149:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420206848 00000100:00100000:0.0:1788359414.290172:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420206848 00000100:00100000:0.0:1788359414.290299:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 224 00000100:00100000:0.0:1788359414.290311:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+59:12486:x1875230420206848:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:0.0:1788359414.290345:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359414.290385:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf3b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71a9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290439:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290457:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290515:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290676:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feaf3b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290697:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.290707:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359414.290711:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359414.290715:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9800, rc 0) 00000100:00100000:0.0:1788359414.290814:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12486:x1875230420206848:12345-192.168.202.52@tcp:101:bash.0 Request processed in 505us (9360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359414.290822:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 224 00000100:00100000:0.0:1788359414.296298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.296561:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207104 00000100:00100000:3.0:1788359414.296575:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207104 00000100:00100000:3.0:1788359414.296906:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 225 00000100:00100000:3.0:1788359414.296935:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+60:12486:x1875230420207104:12345-192.168.202.52@tcp:36:bash.0 00010000:00010000:3.0:1788359414.298798:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.298829:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.298844:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359414.298964:0:6516:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788359414.299825:0:6516:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fce67a6 reply state 00000000a3c75d6e transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.299848:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.299858:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.299861:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359414.299867:0:6516:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359414.300640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12486:x1875230420207104:12345-192.168.202.52@tcp:36:bash.0 Request processed in 3698us (4348us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788359414.300653:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 225 00000020:00080000:3.0:1788359414.300661:0:6516:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788359414.316808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.323826:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207232 00000100:00100000:2.0:1788359414.323849:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207232 00000100:00100000:2.0:1788359414.324207:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 226 00000100:00100000:2.0:1788359414.324222:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12486:x1875230420207232:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359414.324258:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359414.324300:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf3c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71b0 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.324591:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.324610:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 64 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.324620:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.324666:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 64 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.324682:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 64 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359414.324719:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417344:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359414.324837:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359414.328687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.328800:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207360 00000100:00100000:3.0:1788359414.328813:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207360 00010000:00010000:3.0:1788359414.328867:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 65 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.328924:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 101 00000100:00100000:3.0:1788359414.328936:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+65:2404:x1875230420207360:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359414.328995:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359414.329004:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 65 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.329023:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 65 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.329054:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.329060:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.329072:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.329081:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.329105:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359414.329180:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+65:2404:x1875230420207360:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 246us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.329188:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 101 00010000:00010000:2.0:1788359414.330693:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3a3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a2 expref: 64 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359414.330719:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417344:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359414.330748:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.330756:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.330762:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359414.330835:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788359414.330839:0:10096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359414.330864:0:10096:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.330917:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea400/0x49dd053b5feaf3c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 64 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.330933:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 63 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.330943:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:2.0:1788359414.332122:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359414.332134:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eaa00, rc 0) 00000100:00100000:2.0:1788359414.332236:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12486:x1875230420207232:12345-192.168.202.52@tcp:101:bash.0 Request processed in 8013us (15437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359414.332246:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 226 00000100:00100000:0.0:1788359414.342575:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.346477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207616 00000100:00100000:3.0:1788359414.346515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207616 00000100:00100000:3.0:1788359414.346709:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359414.346722:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+63:12486:x1875230420207616:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:3.0:1788359414.347375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+64:12486:x1875230420207616:12345-192.168.202.52@tcp:35:bash.0 Request processed in 652us (4811us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788359414.347385:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359414.450338:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359414.450683:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207744 00000100:00100000:0.0:1788359414.450697:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207744 00000100:00100000:0.0:1788359414.450774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 227 00000100:00100000:0.0:1788359414.450784:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+64:12492:x1875230420207744:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359414.450817:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359414.450841:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf3d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71b7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.450936:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.450972:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.450986:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359414.451040:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788359414.451044:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359414.451066:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.451092:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feaf3d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b7 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.451113:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b7 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.451124:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359414.451127:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359414.451131:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8600, rc 0) 00000100:00100000:0.0:1788359414.451205:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420207744:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 423us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359414.451212:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 227 00000100:00100000:0.0:1788359414.458483:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.458657:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420207872 00000100:00100000:3.0:1788359414.458671:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420207872 00000100:00100000:3.0:1788359414.458736:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 228 00000100:00100000:3.0:1788359414.458749:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420207872:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359414.458777:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359414.458802:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf3e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71be expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458891:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458910:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458923:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458936:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458943:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.458950:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459044:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459053:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459092:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359414.459145:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788359414.459150:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359414.459176:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459190:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459199:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459207:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459213:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459219:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.459224:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459232:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459244:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359414.459248:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359414.459253:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459337:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf3e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459356:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459362:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459368:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459374:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.459377:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459383:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459390:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:3.0:1788359414.459393:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359414.459396:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459400:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf3f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459429:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf3e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71be expref: 67 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459445:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71be expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.459460:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.459463:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359414.459466:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7600, rc 0) 00000100:00100000:3.0:1788359414.459620:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12492:x1875230420207872:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 872us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.459629:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 228 00000100:00100000:1.0:1788359414.470245:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359414.470393:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.471068:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208256 00000100:00100000:2.0:1788359414.471082:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208256 00000100:00100000:2.0:1788359414.471172:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 229 00000100:00100000:2.0:1788359414.471183:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12492:x1875230420208256:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359414.471209:0:10096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359414.471234:0:10096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71c5 expref: -99 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359414.471550:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208000 00000100:00100000:0.0:1788359414.471659:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208000 00000100:00100000:0.0:1788359414.471712:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:0.0:1788359414.471720:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf2509c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+68:2405:x1875230420208000:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359414.471751:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359414.471776:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf3f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71be expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.471798:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359414.471804:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359414.471889:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf2509c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+67:2405:x1875230420208000:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 170us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359414.471897:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00010000:00010000:2.0:1788359414.472400:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.472433:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 66 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.472444:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.472487:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 66 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.472526:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 66 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359414.472545:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417472:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359414.473169:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788359414.495909:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.497042:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445417472:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359414.497081:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.497311:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208384 00000100:00100000:3.0:1788359414.497321:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208384 00010000:00010000:3.0:1788359414.497373:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 67 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.497424:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 102 00000100:00100000:3.0:1788359414.497435:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:2404:x1875230420208384:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359414.497456:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359414.497464:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 67 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.497479:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 67 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.497559:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eaa00/0x49dd053b5feaf3cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b0 expref: 67 pid: 10096 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.497578:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.497583:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.497616:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.497625:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359414.497711:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359414.497796:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+66:2404:x1875230420208384:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 360us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359414.497805:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 102 00010000:00010000:1.0:1788359414.497892:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.497900:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359414.497925:0:10096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788359414.498119:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feaf3fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 67 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.498139:0:10096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 66 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359414.498160:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:1.0:1788359414.498163:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788359414.498166:0:10096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea800, rc 0) 00000100:00100000:1.0:1788359414.498195:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12492:x1875230420208256:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 27014us (27803us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788359414.498202:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 229 00000100:00100000:3.0:1788359414.504615:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.504721:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208640 00000100:00100000:2.0:1788359414.504739:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208640 00000100:00100000:2.0:1788359414.504835:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:2.0:1788359414.504852:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12492:x1875230420208640:12345-192.168.202.52@tcp:103:lfs.0 00010000:00010000:2.0:1788359414.504887:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359414.504921:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf356 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7194 expref: 66 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.505070:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:2.0:1788359414.505077:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359414.505226:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420208640:12345-192.168.202.52@tcp:103:lfs.0 Request processed in 380us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359414.505235:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:3.0:1788359414.515454:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.515578:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208768 00000100:00100000:2.0:1788359414.515595:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208768 00000100:00100000:2.0:1788359414.515682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 230 00000100:00100000:2.0:1788359414.515694:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420208768:12345-192.168.202.52@tcp:58:lfs.0 00010000:00010000:2.0:1788359414.515843:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.515866:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359414.516009:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359414.516158:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788359414.516270:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420208768:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 577us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359414.516279:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 230 00000100:00100000:1.0:1788359414.525000:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.525162:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420208896 00000100:00100000:3.0:1788359414.525175:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420208896 00000100:00100000:3.0:1788359414.525258:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 231 00000100:00100000:3.0:1788359414.525280:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+65:12492:x1875230420208896:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359414.525309:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359414.525339:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71cc expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.525415:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.525428:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.525452:0:7748:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.525467:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.526218:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.526224:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359414.526231:0:7748:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 66 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.526241:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:0.0:1788359414.531033:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12492:x1875230420208896:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 5738us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359414.531050:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 231 00000040:00080000:3.0:1788359414.976336:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359414.976348:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788359414.976384:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:3.0:1788359414.976390:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359414.976811:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445417600:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788359414.977711:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c63960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359414.984239:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359414.984415:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420209024 00000100:00100000:2.0:1788359414.984427:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420209024 00000100:00100000:2.0:1788359414.984554:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 232 00000100:00100000:2.0:1788359414.984567:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209024:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788359414.984625:0:10096:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788359414.984795:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209024:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 230us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359414.984804:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 232 00000100:00100000:0.0:1788359414.989267:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445417600:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359414.990968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359414.991178:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420209152 00000100:00100000:3.0:1788359414.991191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420209152 00000100:00100000:3.0:1788359414.991267:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 233 00000100:00100000:3.0:1788359414.991278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae540a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12493:x1875230420209152:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788359414.991649:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991672:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991686:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991705:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991736:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991745:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991774:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991786:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.991793:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359414.992047:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788359414.992053:0:6516:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359414.992070:0:6516:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992083:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992091:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992098:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992105:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.992110:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992125:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992139:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:3.0:1788359414.992143:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359414.992149:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992156:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf421 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992172:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992178:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992185:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992191:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.992194:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992200:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992207:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffffa0ead27a2b00) 00010000:00010000:3.0:1788359414.992210:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359414.992212:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992227:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf428 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992244:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992250:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992256:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992262:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359414.992265:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992271:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992280:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359414.992282:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359414.992285:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359414.992291:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf42f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359414.993054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae540a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12493:x1875230420209152:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 Request processed in 1765us (2086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359414.993068:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 233 00000100:00100000:1.0:1788359415.004555:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359415.005009:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420209408 00000100:00100000:2.0:1788359415.005024:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420209408 00000100:00100000:2.0:1788359415.005099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 234 00000100:00100000:2.0:1788359415.005111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+66:12493:x1875230420209408:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359415.005151:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359415.005179:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf436 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71d3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005322:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005342:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005385:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359415.005399:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788359415.005534:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005542:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005549:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005556:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359415.005562:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005570:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.005584:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:2.0:1788359415.005588:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788359415.006207:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.006217:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feaf43d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.006276:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf436 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71d3 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.006305:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:2.0:1788359415.006308:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359415.006312:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feaf436 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71d3 expref: 68 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.006322:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb200, rc 0) 00000100:00100000:2.0:1788359415.006779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209408:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1665us (2289us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788359415.006789:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 234 00000100:00100000:1.0:1788359415.021638:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.021828:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420209536 00000100:00100000:3.0:1788359415.021841:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420209536 00000100:00100000:3.0:1788359415.022064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 235 00000100:00100000:3.0:1788359415.022075:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209536:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788359415.022124:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788359415.022257:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209536:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 184us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.022264:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 235 00000100:00100000:0.0:1788359415.028750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.029101:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420209792 00000100:00100000:3.0:1788359415.029116:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420209792 00000100:00100000:3.0:1788359415.029209:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 236 00000100:00100000:3.0:1788359415.029221:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420209792:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.029249:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359415.029252:0:7748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788359415.029288:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8600/0x49dd053b5feaf3db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71b7 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.029312:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359415.029318:0:7748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359415.029336:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf44b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71da expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788359415.030950:0:7748:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788359415.031164:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf452 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.031183:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.031216:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.031297:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf44b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71da expref: 69 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.031318:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71da expref: 68 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.031327:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0ead27a2b00) 00010000:00010000:3.0:1788359415.031330:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359415.031334:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359415.031444:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12493:x1875230420209792:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 2225us (2707us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788359415.031454:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 236 00000100:00100000:0.0:1788359415.038329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.038442:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210048 00000100:00100000:1.0:1788359415.038457:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210048 00000100:00100000:1.0:1788359415.038560:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 237 00000100:00100000:1.0:1788359415.038572:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12493:x1875230420210048:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788359415.038662:0:10096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359415.038698:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf452 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71da expref: 68 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.038724:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0ead27a2b00) 00010000:00010000:1.0:1788359415.038737:0:10096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359415.038766:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.038782:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.038793:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039054:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039077:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039089:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039146:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039153:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039160:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039167:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359415.039171:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039179:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039190:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:1.0:1788359415.039193:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359415.039198:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039204:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf460 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039237:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039243:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039249:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039254:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359415.039257:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039263:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039270:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4bc3ac47 (ffffa0e9c6398f00) 00010000:00010000:1.0:1788359415.039272:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359415.039275:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.039280:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057e00/0x49dd053b5feaf467 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4bc3ac47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359415.039391:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420210048:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 817us (1071us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788359415.039401:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 237 00000100:00100000:1.0:1788359415.044154:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.044252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210176 00000100:00100000:0.0:1788359415.044269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210176 00000100:00100000:0.0:1788359415.044346:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 238 00000100:00100000:0.0:1788359415.044357:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+67:12493:x1875230420210176:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359415.044387:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359415.044434:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf46e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71e1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044478:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044531:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044546:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044699:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feaf46e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 69 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044721:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 68 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.044730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:0.0:1788359415.044734:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359415.044738:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8200, rc 0) 00000100:00100000:0.0:1788359415.044820:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12493:x1875230420210176:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 465us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.044828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 238 00000100:00100000:0.0:1788359415.049860:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.050144:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210432 00000100:00100000:3.0:1788359415.050158:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210432 00000100:00100000:3.0:1788359415.050235:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 239 00000100:00100000:3.0:1788359415.050248:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+68:12493:x1875230420210432:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.050362:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.050395:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.050419:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788359415.050782:0:7748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788359415.050795:0:7748:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 447021299333ns, next at 448021295721ns, rc = 0 00000004:00010000:3.0:1788359415.050861:0:7748:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b0d01f7 reply state 00000000f53f75cc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.050892:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.050902:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:3.0:1788359415.050906:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788359415.050911:0:7748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359415.051382:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+70:12493:x1875230420210432:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 1133us (1533us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788359415.051392:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 239 00000100:00100000:1.0:1788359415.059849:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.060538:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210560 00000100:00100000:3.0:1788359415.060561:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210560 00000100:00100000:3.0:1788359415.060765:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 240 00000100:00100000:3.0:1788359415.060779:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+70:12493:x1875230420210560:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.060811:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359415.060840:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71e8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.060928:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.060947:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 71 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.061216:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:3.0:1788359415.061220:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359415.061224:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6800, rc 0) 00000100:00100000:3.0:1788359415.061309:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+71:12493:x1875230420210560:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 533us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.061318:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 240 00000100:00100000:1.0:1788359415.064680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.064812:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210688 00000100:00100000:3.0:1788359415.064826:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210688 00000100:00100000:3.0:1788359415.064983:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 71 00000100:00100000:3.0:1788359415.064996:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420210688:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788359415.065293:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2404:x1875230420210688:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 300us (797us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788359415.065302:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 71 00000100:00080000:2.0:1788359415.066104:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359415.081725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359415.081903:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420210944 00000100:00100000:2.0:1788359415.081917:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420210944 00000100:00100000:2.0:1788359415.082053:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:2.0:1788359415.082066:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+71:12493:x1875230420210944:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788359415.082444:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+72:12493:x1875230420210944:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 378us (732us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788359415.082454:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:0.0:1788359415.086027:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359415.086361:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211200 00000100:00100000:2.0:1788359415.086387:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211200 00000100:00100000:2.0:1788359415.086473:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 241 00000100:00100000:2.0:1788359415.086485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+72:12493:x1875230420211200:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788359415.087211:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+72:12493:x1875230420211200:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 723us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.087221:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 241 00000100:00100000:0.0:1788359415.091848:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.091999:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211328 00000100:00100000:1.0:1788359415.092012:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211328 00000100:00100000:1.0:1788359415.092088:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 242 00000100:00100000:1.0:1788359415.092099:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+72:12493:x1875230420211328:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359415.092135:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359415.092163:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf48a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71ef expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.092255:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.092274:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.092288:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359415.092345:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788359415.092369:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.092397:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057000/0x49dd053b5feaf48a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71ef expref: 74 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.093665:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71ef expref: 73 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.093678:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:1.0:1788359415.093682:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788359415.093686:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057a00, rc 0) 00000100:00100000:1.0:1788359415.093796:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+73:12493:x1875230420211328:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1698us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359415.093806:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 242 00000100:00100000:0.0:1788359415.099436:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.099771:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211456 00000100:00100000:1.0:1788359415.099785:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211456 00000100:00100000:1.0:1788359415.099911:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 72 00000100:00100000:1.0:1788359415.099925:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+10:2403:x1875230420211456:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359415.099950:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359415.099980:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71f6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359415.100082:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9832f6, blocks: 0x0 00010000:00010000:1.0:1788359415.100128:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=447s v=(0 0) 00010000:00010000:1.0:1788359415.100134:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359415.100149:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.100176:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 11 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.100192:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eb02057e00, rc 0) 00000100:00100000:1.0:1788359415.100281:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2403:x1875230420211456:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 359us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359415.100290:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 72 00000100:00100000:2.0:1788359415.127063:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.129170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211712 00000100:00100000:3.0:1788359415.129194:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211712 00000100:00100000:3.0:1788359415.129298:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 243 00000100:00100000:3.0:1788359415.129311:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+73:12493:x1875230420211712:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788359415.129483:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+73:12493:x1875230420211712:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 174us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.129492:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 243 00000100:00100000:0.0:1788359415.140993:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.141244:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211840 00000100:00100000:3.0:1788359415.141258:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211840 00000100:00100000:3.0:1788359415.141333:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:3.0:1788359415.141345:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+11:12493:x1875230420211840:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.141669:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359415.141698:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e71fd expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.141744:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.141755:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359415.141760:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359415.141765:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.141810:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.141829:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.141847:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445417728:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.145468:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00100000:0.0:1788359415.152952:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.156786:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445417728:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.156834:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.156873:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359415.156986:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+12:12493:x1875230420211840:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 15642us (16007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.156997:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 73 00000100:00100000:1.0:1788359415.157577:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420211968 00000100:00100000:1.0:1788359415.157588:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420211968 00010000:00010000:1.0:1788359415.157693:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359415.157775:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 103 00000100:00100000:1.0:1788359415.157787:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2405:x1875230420211968:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359415.157805:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359415.157834:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.157851:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.157891:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e4e5f40/0x49dd053b5feaf498 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71f6 expref: 12 pid: 8430 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.157912:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359415.157919:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359415.157929:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.157943:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.157984:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359415.158014:0:6502:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445417856:192.168.202.52@tcp:105: 00000100:00100000:1.0:1788359415.158108:0:6502:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac901c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359415.164154:0:6502:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6502:1875230445417856:192.168.202.52@tcp:105: 00010000:00010000:1.0:1788359415.164195:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359415.164273:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2405:x1875230420211968:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 6488us (11335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359415.164286:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 103 00010000:00010000:2.0:1788359415.165243:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359415.168994:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.172007:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212096 00000100:00100000:0.0:1788359415.172031:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212096 00002000:00100000:0.0:1788359415.172116:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffffa0eaffba6680 x1875230420212096/t0(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:741/0 lens 504/0 e 0 to 0 dl 1788359426 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359415.172130:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffba6680 with x1875230420212096 ext(0->12) 00002000:00010000:0.0:1788359415.172140:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffba6680 00000100:00100000:0.0:1788359415.172190:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:0.0:1788359415.172201:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+11:2403:x1875230420212096:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788359415.178045:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:2403:x1875230420212096:12345-192.168.202.52@tcp:4:lhsmtool_posix.0 Request processed in 5829us (9047us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788359415.178065:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00002000:00100000:0.0:1788359415.178084:0:8436:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffffa0eaffba6680 x1875230420212096/t4294967322(0) o4->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:741/0 lens 504/448 e 0 to 0 dl 1788359426 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788359415.178096:0:8436:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0eaffba6680 with x1875230420212096 ext(0->12) 00002000:00010000:0.0:1788359415.178105:0:8436:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0eaffba6680 00000100:00100000:0.0:1788359415.184045:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.184245:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212224 00000100:00100000:1.0:1788359415.184259:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212224 00000100:00100000:1.0:1788359415.184334:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 244 00000100:00100000:1.0:1788359415.184344:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+73:12493:x1875230420212224:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788359415.192944:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1788359415.192965:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788359415.193017:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788359415.193047:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0eaff1cad80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788359415.193054:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0ead22b3b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0eaff1ca180 00000020:00080000:2.0:1788359415.193058:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0ead22b3600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0eac37b2000 00000004:00080000:2.0:1788359415.193093:0:6494:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788359415.193118:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0e9c6a0fb40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788359415.193121:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c6977c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c6a0f900 00000020:00080000:2.0:1788359415.193124:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0e9c6977b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0eacc67f000 00000020:00080000:2.0:1788359415.193137:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788359415.193156:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788359415.193246:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788359415.193550:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788359415.193659:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.193724:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359415.193733:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445417984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788359415.193759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.193797:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445418112 00000100:00100000:3.0:1788359415.193806:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445418112 00000100:00100000:3.0:1788359415.193877:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445417984 00000100:00100000:3.0:1788359415.193881:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445417984 00000100:00100000:3.0:1788359415.193904:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788359415.193913:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445418112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788359415.194057:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788359415.194061:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788359414 00002000:00010000:3.0:1788359415.194063:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788359415.194066:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788359414 -> 1788359414 00002000:00010000:3.0:1788359415.194068:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788359415.194118:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445418112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (459us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788359415.194125:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788359415.194143:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788359415.194149:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445417984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788359415.194165:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1788359415.194189:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.194238:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.194249:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788359415.194254:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359415.194259:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.194296:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.194312:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 12 pid: 8430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.194326:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875230445418240:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.194402:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00080000:3.0:1788359415.194424:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359415.194461:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1788359415.194468:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1788359415.194526:0:3644:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0eaffb83800 x1875230445418112/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788359431 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788359415.194541:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffb83800/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788359415.194547:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445418112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788359415.198884:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359415.198916:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445418368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788359415.199007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359415.199068:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445418368 00000100:00100000:1.0:1788359415.199077:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445418368 00000100:00100000:1.0:1788359415.199146:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788359415.199159:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3644:x1875230445418368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788359415.199194:0:8882:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1788359415.199236:0:8882:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9832f5, atime: 0x6a9832f5, ctime: 0x6a9832f5, blocks: 0x8 00010000:00010000:1.0:1788359415.199246:0:8882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.199267:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:1.0:1788359415.199288:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359415.199296:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.199317:0:8882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.199330:0:8882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.199338:0:8882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.199359:0:8882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788359415.200021:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875230445418240:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.200059:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200110:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359415.200117:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200126:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359415.200131:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200143:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200163:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200171:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db1f80b0/0x49dd053b5feaf4ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.200196:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359415.200198:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359415.200200:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788359415.200209:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359415.200296:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3644:x1875230445418368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1131us (1279us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788359415.200311:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788359415.200337:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12493:x1875230420212224:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 Request processed in 15991us (16302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.200351:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 244 00010000:00010000:0.0:1788359415.201746:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201761:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201769:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201794:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.201800:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201808:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201826:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffffa0e9c6341100) 00010000:00010000:0.0:1788359415.201829:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359415.201834:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201840:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056600/0x49dd053b5feaf1a4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201885:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201893:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201899:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201903:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.201906:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201913:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201932:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffffa0e9c6341700) 00010000:00010000:0.0:1788359415.201934:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359415.201938:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201944:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02056200/0x49dd053b5feaf24c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201960:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201966:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201972:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201978:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.201981:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201986:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.201993:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:0.0:1788359415.201995:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359415.201998:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202003:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feaf2ca lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202026:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202033:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202039:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202044:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.202047:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202052:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202059:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0eafaddd700) 00010000:00010000:0.0:1788359415.202061:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359415.202064:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202068:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ebc00/0x49dd053b5feaf2ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202101:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202109:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202114:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202128:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.202131:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202138:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202148:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359415.202150:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359415.202153:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202159:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6400/0x49dd053b5feaf3bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202174:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202180:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202187:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202192:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359415.202195:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202201:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202216:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:0.0:1788359415.202218:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788359415.202221:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.202228:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6c00/0x49dd053b5feaf47c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788359415.202933:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0e9c8124700/2, rc 0, transno 4294967311 00000100:00100000:2.0:1788359415.202947:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445418368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788359415.204704:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359415.204768:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212352 00000100:00100000:2.0:1788359415.204780:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212352 00010000:00010000:2.0:1788359415.204825:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 13 pid: 8430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359415.204881:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 104 00000100:00100000:2.0:1788359415.204892:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+13:2405:x1875230420212352:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359415.204909:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359415.204928:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 13 pid: 8430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.204943:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 13 pid: 8430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.204978:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a333e90a/0x49dd053b5feaf25a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7155 expref: 13 pid: 8430 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.204995:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359415.204999:0:6500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788359415.205005:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.205013:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.205044:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359415.205266:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2405:x1875230420212352:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 375us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.205275:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 104 00010000:00010000:0.0:1788359415.207940:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.207968:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.207982:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.207990:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.208016:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788359415.208051:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788359415.208106:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00010000:00010000:2.0:1788359415.208114:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.208129:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359415.208134:0:10394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.208162:0:10394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.208183:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.208190:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031e10ec5/0x49dd053b5feaf4a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.208228:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359415.208231:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359415.208234:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359415.208319:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445417984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14165us (14553us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788359415.208331:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788359415.208625:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212480 00000100:00100000:0.0:1788359415.208637:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212480 00000100:00100000:0.0:1788359415.208695:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 77 00000100:00100000:0.0:1788359415.208704:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+12:2404:x1875230420212480:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788359415.209550:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffb80a80/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788359415.209562:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445417984:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788359415.211220:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788359415.211241:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1788359415.211481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420212480:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 Request processed in 2771us (3371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.211492:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 77 00000100:00100000:1.0:1788359415.216285:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.216401:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212736 00000100:00100000:0.0:1788359415.216414:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212736 00000100:00100000:0.0:1788359415.219916:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 245 00000100:00100000:1.0:1788359415.224187:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12493:x1875230420212736:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788359415.224276:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359415.224320:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eb02057a00/0x49dd053b5feaf491 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71ef expref: 21 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.224372:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:1.0:1788359415.224378:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788359415.224422:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.224438:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.224450:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788359415.226205:0:6517:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002741835c reply state 000000006f7548cb transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.226238:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.226250:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:1.0:1788359415.226254:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788359415.226259:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788359415.226479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+22:12493:x1875230420212736:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 6533us (10203us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788359415.226490:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 245 00000100:00100000:2.0:1788359415.229453:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.229552:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420212864 00000100:00100000:1.0:1788359415.229567:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420212864 00000100:00100000:1.0:1788359415.229642:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:1.0:1788359415.229653:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420212864:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788359415.230169:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788359415.230191:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788359414 -> 1788359413 00002000:00010000:1.0:1788359415.230193:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788359413 00002000:00010000:1.0:1788359415.230253:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788359414 -> 1788359413 00002000:00010000:1.0:1788359415.230256:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788359415.230347:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420212864:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 695us (901us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788359415.230357:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 78 00000100:00100000:0.0:1788359415.233541:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.233704:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213120 00000100:00100000:1.0:1788359415.233716:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213120 00000100:00100000:3.0:1788359415.233802:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 246 00000100:00100000:3.0:1788359415.233818:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+22:12493:x1875230420213120:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.233924:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.233944:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.233955:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.233999:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.234017:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 22 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.234037:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445418496:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.234142:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00100000:3.0:1788359415.238889:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445418496:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.238931:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359415.241179:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359415.241374:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213248 00000100:00100000:2.0:1788359415.241387:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213248 00010000:00010000:2.0:1788359415.241452:0:6501:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 23 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359415.241559:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:2.0:1788359415.241570:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+23:2405:x1875230420213248:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359415.241588:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359415.241596:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 23 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241613:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 23 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241657:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8200/0x49dd053b5feaf475 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e1 expref: 23 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241679:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:2.0:1788359415.241686:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241698:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241707:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.241739:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359415.241812:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2405:x1875230420213248:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 244us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.241821:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 105 00010000:00010000:3.0:1788359415.242595:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242620:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242669:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242677:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242684:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242691:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359415.242696:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242705:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242718:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:3.0:1788359415.242722:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788359415.242726:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.242732:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4bb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.242799:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12493:x1875230420213120:12345-192.168.202.52@tcp:55:lhsmtool_posix.0 Request processed in 8984us (9378us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788359415.242810:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 246 00000100:00100000:2.0:1788359415.246995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.247088:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213376 00000100:00100000:3.0:1788359415.247102:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213376 00000100:00100000:3.0:1788359415.247234:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 79 00000100:00100000:3.0:1788359415.247248:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2404:x1875230420213376:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.247312:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.247339:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.247350:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359415.247354:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788359415.247359:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.247423:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.247441:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 8 pid: 8433 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.247459:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445418624:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.247611:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359415.251256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359415.251343:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213504 00000100:00100000:1.0:1788359415.251355:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213504 00010000:00010000:1.0:1788359415.251421:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 9 pid: 8433 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359415.251474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00100000:1.0:1788359415.251487:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420213504:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359415.251543:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359415.251573:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 9 pid: 8433 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.251591:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 9 pid: 8433 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.251625:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359415.251631:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788359415.251638:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.251668:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.251696:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359415.251762:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+9:2404:x1875230420213504:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 278us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359415.251771:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 106 00010000:00010000:3.0:1788359415.253616:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcffa094/0x49dd053b5feaf49f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71fd expref: 8 pid: 8433 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.253646:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1875230445418624:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.253697:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253813:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253823:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253860:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253896:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253905:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253914:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359415.253918:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253928:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253947:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.253955:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000157355d4/0x49dd053b5feaf4c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359415.254111:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2404:x1875230420213376:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 Request processed in 6865us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.254121:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 79 00000100:00100000:2.0:1788359415.257434:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.257545:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213760 00000100:00100000:3.0:1788359415.257559:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213760 00000100:00100000:3.0:1788359415.257627:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 247 00000100:00100000:3.0:1788359415.257640:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+21:12493:x1875230420213760:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788359415.257745:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.257765:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.257775:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.257817:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.257833:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 21 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.257849:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445418752:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.257969:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359415.265677:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.265902:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445418752:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.265939:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359415.266183:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420213888 00000100:00100000:2.0:1788359415.266193:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420213888 00010000:00010000:2.0:1788359415.266244:0:6500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 22 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359415.266294:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 107 00000100:00100000:2.0:1788359415.266303:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2405:x1875230420213888:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359415.266321:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359415.266329:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 22 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266342:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 22 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266379:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feaf3b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71a9 expref: 22 pid: 6517 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266407:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:2.0:1788359415.266415:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 21 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266428:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266437:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266446:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359415.266476:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359415.266584:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+21:2405:x1875230420213888:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 281us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.266593:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 107 00010000:00010000:3.0:1788359415.266753:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.266761:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.266999:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.267013:0:10096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.267022:0:10096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.267057:0:10096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.267073:0:10096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 21 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.267089:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445418880:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.267149:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359415.270761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.270914:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420214016 00000100:00100000:0.0:1788359415.270925:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420214016 00010000:00010000:0.0:1788359415.270975:0:10335:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 22 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359415.271025:0:10335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 108 00000100:00100000:0.0:1788359415.271036:0:10335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2405:x1875230420214016:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359415.271056:0:10335:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359415.271065:0:10335:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 22 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.271081:0:10335:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 22 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.271108:0:10335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:0.0:1788359415.271114:0:10335:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.271126:0:10335:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.271156:0:10335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.271180:0:10335:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359415.271256:0:10335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2405:x1875230420214016:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 221us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.271266:0:10335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 108 00010000:00010000:3.0:1788359415.271375:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf483 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71e8 expref: 21 pid: 6515 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.271397:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445418880:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.271431:0:10096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.271448:0:10096:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.271454:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359415.271661:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788359415.271797:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788359415.271837:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788359415.271944:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445419008:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788359415.272006:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.272038:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396480 going to sleep for 11 seconds 00000100:00100000:0.0:1788359415.272248:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419008 00000100:00100000:0.0:1788359415.272254:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419008 00000100:00100000:0.0:1788359415.272299:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788359415.272307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10096:x1875230445419008:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788359415.272392:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10096:x1875230445419008:12345-0@lo:1000:mdt00_004.0 Request processed in 85us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.272412:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788359415.273184:0:10096:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788359415.273193:0:10096:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffb83800, transno 4294967323 00000004:00080000:3.0:1788359415.273203:0:10096:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffb80a80, transno 4294967324 00000100:00100000:3.0:1788359415.273210:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445419008:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788359415.273377:0:10096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788359415.273780:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445419136:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788359415.273842:0:10096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.273879:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396840 going to sleep for 11 seconds 00000100:00100000:0.0:1788359415.275102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419136 00000100:00100000:0.0:1788359415.275117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419136 00000100:00100000:0.0:1788359415.275191:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788359415.275202:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10096:x1875230445419136:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788359415.275449:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10096:x1875230445419136:12345-0@lo:1000:mdt00_004.0 Request processed in 248us (1605us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788359415.275457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788359415.275773:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10096:1875230445419136:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788359415.275832:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275845:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275854:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275894:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359415.275901:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275910:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275930:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:1.0:1788359415.275933:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788359415.275957:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275964:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf4d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.275994:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276000:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276006:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276011:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359415.276014:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276020:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276028:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:1.0:1788359415.276030:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788359415.276038:0:10096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276050:0:10096:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276060:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.276113:0:10096:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 24 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359415.276129:0:10096:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445419264:192.168.202.52@tcp:105: 00000100:00100000:1.0:1788359415.276229:0:10096:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaf6c01540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359415.279408:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.279558:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420214144 00000100:00100000:0.0:1788359415.279571:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420214144 00000100:00100000:0.0:1788359415.279640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:0.0:1788359415.279652:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12492:x1875230420214144:12345-192.168.202.52@tcp:49:lfs.0 00000100:00100000:0.0:1788359415.280252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+25:12492:x1875230420214144:12345-192.168.202.52@tcp:49:lfs.0 Request processed in 598us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.280277:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:3.0:1788359415.280717:0:10096:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10096:1875230445419264:192.168.202.52@tcp:105: 00010000:00010000:3.0:1788359415.280757:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280770:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feaf413 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6515 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280810:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280838:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280853:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280878:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280885:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280892:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280899:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359415.280903:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280910:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280922:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359415.280926:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359415.280930:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280935:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280946:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280958:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280964:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280969:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359415.280971:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280977:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280984:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359415.280986:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788359415.280989:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.280995:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.281183:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+24:12493:x1875230420213760:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 23545us (23764us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788359415.281193:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 247 00000020:00080000:3.0:1788359415.281198:0:10096:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788359415.284422:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359415.284436:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359415.285007:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1788359415.285024:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788359415.289006:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.289970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.290076:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420214656 00000100:00100000:0.0:1788359415.290090:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420214656 00000100:00100000:0.0:1788359415.290161:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 62 00000100:00100000:0.0:1788359415.290174:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+24:12493:x1875230420214656:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788359415.290591:0:14274:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788359415.290635:0:14274:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788359415.290678:0:14274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290697:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290711:0:14274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290721:0:14274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290727:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290734:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.290757:0:14274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788359415.290894:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d93850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+26:12493:x1875230420214656:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 723us (927us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788359415.290904:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 62 00000020:00080000:0.0:1788359415.290910:0:14274:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788359415.291262:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359415.291271:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.291289:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359415.291294:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.291303:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.291318:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:3.0:1788359415.291321:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788359415.291326:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.291332:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9400/0x49dd053b5feaf4de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14274 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.291346:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359415.291348:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359415.291350:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359415.291847:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420214400 00000100:00100000:2.0:1788359415.291858:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420214400 00000100:00100000:2.0:1788359415.291924:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:2.0:1788359415.291934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+26:12492:x1875230420214400:12345-192.168.202.52@tcp:58:lfs.0 00000040:00080000:2.0:1788359415.292100:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788359415.292172:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+26:12492:x1875230420214400:12345-192.168.202.52@tcp:58:lfs.0 Request processed in 239us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.292180:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 248 00000100:00100000:1.0:1788359415.329873:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.330003:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420214784 00000100:00100000:3.0:1788359415.330018:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420214784 00000100:00100000:3.0:1788359415.330095:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 249 00000100:00100000:3.0:1788359415.330108:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+26:12495:x1875230420214784:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359415.330139:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359415.330168:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7204 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330252:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330291:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330305:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330323:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330331:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330338:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330979:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.330998:0:7748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 27 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.331008:0:7748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.331054:0:7748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 27 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.331072:0:7748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 27 pid: 10096 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359415.331107:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445419392:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359415.331272:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6396780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359415.336066:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359415.336203:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7748:1875230445419392:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359415.336238:0:7748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359415.336338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215040 00000100:00100000:0.0:1788359415.336349:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215040 00000100:00100000:0.0:1788359415.336444:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:0.0:1788359415.336456:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+28:6173:x1875230420215040:12345-192.168.202.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788359415.337113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+29:6173:x1875230420215040:12345-192.168.202.52@tcp:35:ldlm_bl.0 Request processed in 656us (1060us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788359415.337123:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:1.0:1788359415.339993:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359415.340134:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215168 00000100:00100000:0.0:1788359415.340147:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215168 00010000:00010000:0.0:1788359415.340194:0:7465:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 29 pid: 10096 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359415.340244:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 109 00000100:00100000:0.0:1788359415.340254:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+29:2405:x1875230420215168:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359415.340272:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359415.340279:0:7465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 29 pid: 10096 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.340294:0:7465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 29 pid: 10096 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.340320:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feaf405 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71c5 expref: 29 pid: 10096 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.340360:0:7465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359415.340367:0:7465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.340388:0:7465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359415.340396:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359415.341270:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359415.341356:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+28:2405:x1875230420215168:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 1098us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359415.341376:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 109 00010000:00010000:3.0:1788359415.343594:0:7748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.343702:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359415.343780:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788359415.343786:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359415.343815:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.343835:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.343848:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.343855:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351327:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351344:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359415.351386:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351406:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351430:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:3.0:1788359415.351434:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359415.351439:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351446:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf4ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351474:0:7748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351481:0:7748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351487:0:7748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351508:0:7748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359415.351512:0:7748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351518:0:7748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351526:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffffa0ead27a2d00) 00010000:00010000:3.0:1788359415.351528:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359415.351537:0:7748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351543:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf4f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351618:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf4e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7204 expref: 28 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351640:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7204 expref: 27 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359415.351648:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359415.351650:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359415.351653:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:2.0:1788359415.351936:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12495:x1875230420214784:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 21827us (22085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.351948:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 249 00000100:00100000:0.0:1788359415.484826:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445419520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359415.484936:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359415.485028:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419520 00000100:00100000:0.0:1788359415.485037:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419520 00000100:00100000:0.0:1788359415.485118:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788359415.485128:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445419520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359415.485166:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788359415.485216:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445419520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.485223:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788359415.485283:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445419520:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788359415.485628:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359415.486220:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445419776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359415.486281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359415.486344:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419776 00000100:00100000:2.0:1788359415.486351:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419776 00000100:00100000:2.0:1788359415.486390:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788359415.486733:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445419776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359415.486761:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:2.0:1788359415.486816:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445419776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 417us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.486825:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788359415.486884:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445419776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359415.487244:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445419648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359415.487285:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359415.487319:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419648 00000100:00100000:0.0:1788359415.487323:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419648 00000100:00100000:0.0:1788359415.487352:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788359415.487381:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3643:x1875230445419648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359415.487511:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445419904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359415.487774:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788359415.488019:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788359415.488187:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445419904 00000100:00100000:3.0:1788359415.488193:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445419904 00000100:00100000:3.0:1788359415.488243:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788359415.488251:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eb00b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445419904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359415.488266:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:3.0:1788359415.488304:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eb00b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445419904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.488311:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788359415.488520:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3643:x1875230445419648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1139us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.488528:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788359415.488721:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445419648:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788359415.488783:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359415.488810:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445419904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359415.489763:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445420288:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.489836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.489883:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445420800:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.489930:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.489965:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788359415.489971:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445420416:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.489994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490015:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445420928:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490071:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445420160:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490113:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445420672:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490145:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788359415.490150:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445420032:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490194:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445420544:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490213:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490225:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445421056:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.490242:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359415.490265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420800 00000100:00100000:3.0:1788359415.490272:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420800 00000100:00100000:3.0:1788359415.490318:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420416 00000100:00100000:3.0:1788359415.490321:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420416 00000100:00100000:3.0:1788359415.490333:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420928 00000100:00100000:3.0:1788359415.490336:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420928 00000100:00100000:3.0:1788359415.490349:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420160 00000100:00100000:3.0:1788359415.490352:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420160 00000100:00100000:3.0:1788359415.490376:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420672 00000100:00100000:3.0:1788359415.490380:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420672 00000100:00080000:2.0:1788359415.491768:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359415.491778:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359415.491797:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421056 00000100:00100000:2.0:1788359415.491806:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421056 00000100:00100000:2.0:1788359415.491876:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788359415.491887:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445420800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.491990:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445420800:12345-0@lo:400:kworker.0 Request processed in 106us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.491998:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788359415.492018:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788359415.492026:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445420416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492058:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445420416:12345-0@lo:400:kworker.0 Request processed in 33us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.492064:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788359415.492077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788359415.492083:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445420928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492113:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445420928:12345-0@lo:400:kworker.0 Request processed in 31us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.492119:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788359415.492135:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788359415.492142:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445420160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445420160:12345-0@lo:400:kworker.0 Request processed in 49us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.492197:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788359415.492213:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788359415.492219:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445421056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445421056:12345-0@lo:400:kworker.0 Request processed in 28us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359415.492253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00080000:2.0:1788359415.492269:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359415.492307:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445420416:0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492321:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445420928:0@lo:400:kworker.0 00010000:00080000:2.0:1788359415.492338:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb80700 x1875230445420800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359415.492350:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445420800:0@lo:400:kworker.0 00010000:00080000:2.0:1788359415.492390:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb80380 x1875230445421056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359415.492416:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445421056:0@lo:400:kworker.0 00000100:00100000:2.0:1788359415.492431:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445420160:0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.492764:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420288 00000100:00100000:0.0:1788359415.492771:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420288 00000100:00100000:0.0:1788359415.492811:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420544 00000100:00100000:0.0:1788359415.492814:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420544 00000100:00100000:0.0:1788359415.492830:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788359415.492837:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445420288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.492903:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445420288:12345-0@lo:400:kworker.0 Request processed in 66us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.492909:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788359415.492923:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788359415.492929:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445420544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.492957:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445420544:12345-0@lo:400:kworker.0 Request processed in 29us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.492962:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788359415.492984:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445420032 00000100:00100000:0.0:1788359415.492988:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445420032 00000100:00100000:0.0:1788359415.493018:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788359415.493025:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445420032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.493056:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae5510050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3643:x1875230445420032:12345-0@lo:400:kworker.0 Request processed in 32us (2878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359415.493062:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788359415.493130:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445420288:0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.493162:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445420032:0@lo:400:kworker.0 00000100:00100000:0.0:1788359415.493173:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445420544:0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.493693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788359415.493706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445420672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359415.493764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445420672:12345-0@lo:400:kworker.0 Request processed in 62us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359415.493770:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788359415.493985:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445420672:0@lo:400:kworker.0 00000001:00080000:3.0:1788359415.999800:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788359415.999828:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1788359416.188641:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788359416.248723:0:14758:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359416.248735:0:14758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788359416.248775:0:14758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1788359416.248781:0:14758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788359416.320269:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359416.320284:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359416.320322:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788359416.320329:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788359416.320616:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb85f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445421184:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359416.320751:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a79cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359416.329730:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359416.330067:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215296 00000100:00100000:0.0:1788359416.330082:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215296 00000100:00100000:0.0:1788359416.330173:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 250 00000100:00100000:0.0:1788359416.330186:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+28:12507:x1875230420215296:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788359416.330236:0:6515:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788359416.330404:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+28:12507:x1875230420215296:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 220us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359416.330413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 250 00000100:00080000:3.0:1788359416.330626:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359416.331090:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb85f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875230445421184:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788359416.334998:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359416.335158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215552 00000100:00100000:3.0:1788359416.335172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215552 00000100:00100000:3.0:1788359416.335257:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 251 00000100:00100000:3.0:1788359416.335269:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+27:12507:x1875230420215552:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788359416.335298:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359416.335326:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf501 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e720b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359416.335473:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359416.335491:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359416.335535:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359416.335550:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788359416.335706:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7600/0x49dd053b5feaf501 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e720b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359416.335753:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e720b expref: 29 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359416.335764:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359416.335768:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788359416.335772:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359416.340462:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+29:12507:x1875230420215552:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 5175us (5459us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788359416.340480:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 251 00000100:00100000:1.0:1788359416.354384:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359416.354439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359416.354475:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215808 00000100:00100000:1.0:1788359416.354488:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215808 00000100:00100000:1.0:1788359416.354581:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 252 00000100:00100000:1.0:1788359416.354593:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+29:12507:x1875230420215808:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788359416.354703:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.354726:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.354756:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.354974:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.354984:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355158:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355167:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359416.355172:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355180:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355195:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:1.0:1788359416.355199:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788359416.355204:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355211:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf516 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359416.355379:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+30:12507:x1875230420215808:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 787us (1006us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788359416.355389:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 252 00000100:00100000:1.0:1788359416.355457:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420215936 00000100:00100000:1.0:1788359416.355462:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420215936 00000100:00100000:1.0:1788359416.355527:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:1.0:1788359416.355536:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:2402:x1875230420215936:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359416.355550:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359416.355566:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feaf508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e720b expref: 30 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359416.355579:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:1.0:1788359416.355583:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359416.355604:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+29:2402:x1875230420215936:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 71us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359416.355611:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00000040:00080000:3.0:1788359416.356129:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788359416.356137:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788359416.356810:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:3.0:1788359416.356822:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359416.359949:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359416.360414:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216192 00000100:00100000:0.0:1788359416.360429:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216192 00000100:00100000:0.0:1788359416.360581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:0.0:1788359416.360594:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+29:12507:x1875230420216192:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788359416.360923:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:12507:x1875230420216192:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 331us (990us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788359416.360941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 64 00000040:00080000:0.0:1788359417.213371:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788359417.215169:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359417.275437:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.275637:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216320 00000100:00100000:3.0:1788359417.275663:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216320 00000100:00100000:3.0:1788359417.275740:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 387 00000100:00100000:3.0:1788359417.275752:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420216320:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359417.276389:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2404:x1875230420216320:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 629us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359417.276400:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 387 00000100:00100000:3.0:1788359417.289686:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289747:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289777:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289876:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289905:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359417.289940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216448 00000100:00100000:3.0:1788359417.289953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216448 00000100:00100000:3.0:1788359417.290019:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216960 00000100:00100000:3.0:1788359417.290022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216960 00000100:00100000:3.0:1788359417.290050:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216576 00000100:00100000:3.0:1788359417.290053:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216576 00000100:00100000:3.0:1788359417.290067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217088 00000100:00100000:3.0:1788359417.290069:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217088 00000100:00100000:3.0:1788359417.290089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 325 00000100:00100000:3.0:1788359417.290100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:2405:x1875230420216448:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359417.290214:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:2405:x1875230420216448:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 115us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359417.290223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 325 00000100:00100000:3.0:1788359417.290242:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 326 00000100:00100000:3.0:1788359417.290248:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420216960:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359417.290276:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420216960:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359417.290283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 326 00000100:00100000:3.0:1788359417.290295:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 327 00000100:00100000:3.0:1788359417.290301:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420216576:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359417.290326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420216576:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359417.290332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 327 00000100:00100000:3.0:1788359417.290342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 328 00000100:00100000:3.0:1788359417.290356:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420217088:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359417.290381:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2405:x1875230420217088:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359417.290388:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 328 00000100:00080000:3.0:1788359417.290406:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359417.290410:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359417.290971:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216704 00000100:00100000:2.0:1788359417.290979:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216704 00000100:00100000:2.0:1788359417.291038:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420216832 00000100:00100000:2.0:1788359417.291042:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420216832 00000100:00100000:2.0:1788359417.291074:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 102 00000100:00100000:2.0:1788359417.291082:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420216704:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359417.291125:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420216704:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 45us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359417.291132:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 102 00000100:00100000:2.0:1788359417.291146:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 103 00000100:00100000:2.0:1788359417.291152:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420216832:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359417.291174:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2405:x1875230420216832:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359417.291179:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 103 00000100:00080000:3.0:1788359417.291891:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359417.291897:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788359417.990585:0:14810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788359417.990598:0:14810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359417.990646:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788359417.990656:0:14810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359418.048734:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359418.048769:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445421312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359418.048884:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359418.050153:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421312 00000100:00100000:1.0:1788359418.050182:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421312 00000100:00100000:1.0:1788359418.050260:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788359418.050271:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445421312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359418.050316:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359418.050416:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445421312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359418.050423:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788359418.050483:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445421312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359418.166250:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359418.166293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217344 00000100:00100000:0.0:1788359418.166303:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217344 00000100:00100000:0.0:1788359418.166377:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 253 00000100:00100000:0.0:1788359418.166388:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+30:12527:x1875230420217344:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359418.166409:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359418.166432:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf51d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7212 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359418.166566:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf524 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359418.166582:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359418.166595:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf524 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6516 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359418.166606:0:6516:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788359418.166713:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8a00/0x49dd053b5feaf51d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7212 expref: 33 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359418.166732:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf524 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7212 expref: 32 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359418.166754:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359418.166756:0:6516:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788359418.166760:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9c00, rc 0) 00000100:00100000:0.0:1788359418.166817:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+32:12527:x1875230420217344:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 431us (577us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788359418.166823:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 253 00000100:00080000:0.0:1788359418.166862:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359418.172592:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359418.172690:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217472 00000100:00100000:3.0:1788359418.172701:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217472 00000100:00100000:3.0:1788359418.172788:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 254 00000100:00100000:3.0:1788359418.172798:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+32:12527:x1875230420217472:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:3.0:1788359418.172875:0:10096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172892:0:10096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172904:0:10096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172937:0:10096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172944:0:10096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172964:0:10096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172970:0:10096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359418.172975:0:10096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172983:0:10096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.172995:0:10096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:3.0:1788359418.172998:0:10096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359418.173002:0:10096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359418.173008:0:10096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6800/0x49dd053b5feaf532 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359418.173075:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:10b7ecde-1562-4877-be1f-e5861af40d5e+32:12527:x1875230420217472:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 278us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359418.173082:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 254 00010000:00010000:3.0:1788359418.236790:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359418.269971:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359418.270072:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217600 00000100:00100000:2.0:1788359418.270082:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217600 00000100:00100000:2.0:1788359418.270145:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 80 00000100:00100000:2.0:1788359418.270155:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2405:x1875230420217600:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:2.0:1788359418.270174:0:8882:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359418.270198:0:8882:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff3f6963/0x49dd053b5feaf539 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7219 expref: -99 pid: 8882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359418.270225:0:8882:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9832f5, atime: 0x6a9832f5, ctime: 0x6a9832f5, blocks: 0x8 00010000:00010000:2.0:1788359418.270245:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1788359418.270249:0:8882:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359418.270260:0:8882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff3f6963/0x49dd053b5feaf539 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7219 expref: 8 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359418.270294:0:8882:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff3f6963/0x49dd053b5feaf539 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7219 expref: 8 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359418.270308:0:8882:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea400, rc 0) 00000100:00100000:2.0:1788359418.270454:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2405:x1875230420217600:12345-192.168.202.52@tcp:101:cat.0 Request processed in 300us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359418.270462:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 80 00000100:00100000:1.0:1788359418.278435:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359418.278693:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217728 00000100:00100000:2.0:1788359418.278704:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217728 00002000:00100000:2.0:1788359418.278758:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffffa0ead28dc700 x1875230420217728/t0(0) o3->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:744/0 lens 488/0 e 0 to 0 dl 1788359429 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359418.278770:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ead28dc700 with x1875230420217728 ext(0->4095) 00002000:00010000:2.0:1788359418.278776:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0ead28dc700 00000100:00100000:2.0:1788359418.278801:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:2.0:1788359418.278811:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2402:x1875230420217728:12345-192.168.202.52@tcp:3:cat.0 00000100:00100000:2.0:1788359418.279031:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+8:2402:x1875230420217728:12345-192.168.202.52@tcp:3:cat.0 Request processed in 220us (604us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788359418.279039:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00002000:00100000:2.0:1788359418.279046:0:8438:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffffa0ead28dc700 x1875230420217728/t0(0) o3->10b7ecde-1562-4877-be1f-e5861af40d5e@192.168.202.52@tcp:744/0 lens 488/4536 e 0 to 0 dl 1788359429 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788359418.279054:0:8438:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0ead28dc700 with x1875230420217728 ext(0->4095) 00002000:00010000:2.0:1788359418.279058:0:8438:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0ead28dc700 00000040:00080000:1.0:1788359418.428739:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788359418.428760:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359418.428868:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788359418.428879:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788359418.556820:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359418.557067:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445421440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359418.557380:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359418.562623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421440 00000100:00100000:2.0:1788359418.562654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421440 00000100:00100000:2.0:1788359418.562795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788359418.562806:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0df0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445421440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788359418.562856:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788359418.562955:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0df0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445421440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359418.562963:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788359418.563425:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445421440:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788359419.262136:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359420.284929:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359420.604657:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445421568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359420.604665:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445421696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359420.607073:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.607084:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445421952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359420.607126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.607161:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445421824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359420.607185:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.607286:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445422080:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.607316:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421696 00000100:00100000:2.0:1788359420.607325:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421696 00000100:00100000:0.0:1788359420.607330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.607362:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445422592:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.607381:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421952 00000100:00100000:2.0:1788359420.607386:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421952 00000100:00100000:2.0:1788359420.607401:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421824 00000100:00100000:2.0:1788359420.607404:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421824 00000100:00100000:2.0:1788359420.607420:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788359420.607430:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445421696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359420.607438:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788359420.607464:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359420.607466:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445423104:0@lo:400:kworker.0 00000100:00100000:1.0:1788359420.607565:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788359420.607574:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445421952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359420.607586:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788359420.608169:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.608188:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445421696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 757us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.608196:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788359420.608217:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359420.608225:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445421824:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359420.608232:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445421696:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788359420.608256:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788359420.608256:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788359420.608266:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445422464:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608299:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445421824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.608307:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.608313:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788359420.608339:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423104 00000100:00100000:0.0:1788359420.608344:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423104 00000100:00080000:2.0:1788359420.608345:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359420.608352:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359420.608355:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359420.608382:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422464 00000100:00100000:2.0:1788359420.608385:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445421824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359420.608387:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422464 00000100:00100000:2.0:1788359420.608403:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445422336:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608423:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788359420.608432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445423104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608438:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.608464:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445422848:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445423104:12345-0@lo:400:kworker.0 Request processed in 48us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.608488:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788359420.608515:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.608540:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788359420.608547:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445422208:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608547:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422848 00000100:00100000:0.0:1788359420.608554:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422848 00000100:00100000:2.0:1788359420.608579:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.608586:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788359420.608595:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445422464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608599:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445422720:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608642:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445422464:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.608643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.608654:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788359420.608664:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445423232:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608668:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422208 00000100:00100000:0.0:1788359420.608673:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422208 00000100:00100000:0.0:1788359420.608691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422720 00000100:00100000:0.0:1788359420.608695:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422720 00000100:00100000:2.0:1788359420.608699:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.608718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423232 00000100:00100000:0.0:1788359420.608722:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423232 00000100:00100000:2.0:1788359420.608733:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422592 00000100:00100000:2.0:1788359420.608740:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422592 00000100:00100000:0.0:1788359420.608742:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788359420.608751:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445422848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608776:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422336 00000100:00100000:2.0:1788359420.608780:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422336 00000100:00100000:0.0:1788359420.608793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445422848:12345-0@lo:400:kworker.0 Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.608801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788359420.608805:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788359420.608828:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445422592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788359420.608843:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445422208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608873:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445422592:12345-0@lo:400:kworker.0 Request processed in 47us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.608883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445422208:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.608893:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788359420.608903:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788359420.608910:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788359420.608919:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445422336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.608924:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788359420.608936:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445422720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.608959:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445422336:12345-0@lo:400:kworker.0 Request processed in 41us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.608964:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788359420.608990:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788359420.608991:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445422720:12345-0@lo:400:kworker.0 Request processed in 58us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.608999:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788359420.609004:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445423232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.609025:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422080 00000100:00100000:0.0:1788359420.609030:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422080 00000100:00100000:2.0:1788359420.609044:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445423232:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.609052:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788359420.609061:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788359420.609070:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445422080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788359420.609080:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359420.609086:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359420.609106:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3645:x1875230445422080:12345-0@lo:400:kworker.0 Request processed in 38us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.609115:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788359420.609117:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359420.609159:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445421568 00000100:00100000:2.0:1788359420.609164:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445421568 00000100:00100000:0.0:1788359420.609183:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445422464:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.609192:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445422976:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.609198:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788359420.609208:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445421568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359420.609220:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788359420.609224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359420.609251:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445422976 00000100:00100000:0.0:1788359420.609255:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445422976 00000100:00100000:2.0:1788359420.609268:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445421568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359420.609275:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788359420.609286:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788359420.609295:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445422976:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788359420.609297:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359420.609326:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445421568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359420.609333:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445422976:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.609340:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359420.609358:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445422208:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.609375:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445422976:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.609386:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445422720:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.609405:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445423104:0@lo:400:kworker.0 00010000:00080000:2.0:1788359420.609408:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead2750a80 x1875230445423232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359420.609419:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445422080:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.609421:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445423232:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.609438:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445422592:0@lo:400:kworker.0 00000100:00100000:2.0:1788359420.609443:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445422336:0@lo:400:kworker.0 00010000:00080000:2.0:1788359420.609460:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffba7480 x1875230445422848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359420.609468:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445422848:0@lo:400:kworker.0 00000100:00100000:0.0:1788359420.611938:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445421952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4358us (4805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359420.611952:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788359420.612365:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788359420.612372:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1788359420.612402:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0e9c81d9180, transno 4294967308 00000004:00080000:2.0:1788359420.612450:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788359420.612464:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0e9c8124700, transno 4294967311 00000100:00100000:2.0:1788359420.616428:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445421952:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788359420.617825:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788359420.617864:0:6494:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0e9c6396480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788359420.617868:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c6396240 00000020:00080000:0.0:1788359420.617872:0:6494:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa0eaff392e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0e9c80fb000 00000020:00080000:0.0:1788359420.617891:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788359420.617912:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:3.0:1788359420.617931:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359420.617949:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359420.617957:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359420.617965:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359420.617970:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788359420.617972:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788359420.617982:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359420.618000:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffffa0e9c6341a00) 00010000:00010000:3.0:1788359420.618003:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359420.618008:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359420.618014:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031e00/0x49dd053b5feaf4b4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359421.117706:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1788359421.117717:0:8425:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:3.0:1788359421.308933:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359422.231078:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359422.231172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217856 00000100:00100000:0.0:1788359422.231187:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217856 00000100:00100000:0.0:1788359422.231290:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 255 00000100:00100000:0.0:1788359422.231303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:12181:x1875230420217856:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788359422.231435:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+18:12181:x1875230420217856:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 Request processed in 135us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359422.231445:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 255 00000100:00080000:2.0:1788359422.231511:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788359422.235832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359422.236043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420217984 00000100:00100000:1.0:1788359422.236055:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420217984 00000100:00100000:1.0:1788359422.236151:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 256 00000100:00100000:1.0:1788359422.236165:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:12181:x1875230420217984:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788359422.236228:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359422.236306:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:12181:x1875230420217984:12345-192.168.202.52@tcp:60:lhsmtool_posix.0 Request processed in 145us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359422.236314:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 256 00000100:00100000:1.0:1788359422.255938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359422.256034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218240 00000100:00100000:0.0:1788359422.256047:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218240 00000100:00100000:0.0:1788359422.256119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 65 00000100:00100000:0.0:1788359422.256131:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+18:12181:x1875230420218240:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788359422.256427:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+19:12181:x1875230420218240:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 298us (501us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788359422.256434:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 65 00010000:00010000:3.0:1788359422.332629:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359422.394743:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359422.394802:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359422.394846:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359422.394876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359422.394906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359422.394960:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218624 00000100:00100000:2.0:1788359422.394972:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218624 00000100:00100000:2.0:1788359422.395044:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218496 00000100:00100000:2.0:1788359422.395048:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218496 00000100:00100000:2.0:1788359422.395075:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:2.0:1788359422.395087:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420218624:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359422.395178:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2403:x1875230420218624:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 92us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359422.395186:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 105 00000100:00100000:2.0:1788359422.395205:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00100000:2.0:1788359422.395212:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2403:x1875230420218496:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359422.395238:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2403:x1875230420218496:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359422.395244:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 106 00000100:00080000:2.0:1788359422.395267:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359422.395272:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359422.395411:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218880 00000100:00100000:3.0:1788359422.395417:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218880 00000100:00100000:3.0:1788359422.395462:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218752 00000100:00100000:3.0:1788359422.395465:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218752 00000100:00100000:3.0:1788359422.395489:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 335 00000100:00100000:3.0:1788359422.395534:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420218880:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359422.395568:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420218880:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 73us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359422.395585:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 335 00000100:00100000:3.0:1788359422.395600:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 336 00000100:00100000:3.0:1788359422.395606:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420218752:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:3.0:1788359422.395635:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2403:x1875230420218752:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359422.395640:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 336 00000100:00080000:3.0:1788359422.395656:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788359422.395659:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788359422.395741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420218368 00000100:00100000:0.0:1788359422.395747:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420218368 00000100:00100000:0.0:1788359422.395789:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 389 00000100:00100000:0.0:1788359422.395806:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420218368:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:0.0:1788359422.395837:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2403:x1875230420218368:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 40us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359422.395844:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 389 00000100:00100000:3.0:1788359422.411868:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359422.412027:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420219008 00000100:00100000:1.0:1788359422.412041:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420219008 00000100:00100000:1.0:1788359422.412116:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 257 00000100:00100000:1.0:1788359422.412128:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:12985:x1875230420219008:12345-192.168.202.52@tcp:101:lsof.0 00010000:00010000:1.0:1788359422.412157:0:7748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359422.412185:0:7748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7220 expref: -99 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412273:0:7748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412292:0:7748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412442:0:7748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359422.412592:0:7748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788359422.412597:0:7748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788359422.412629:0:7748:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412658:0:7748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0031800/0x49dd053b5feaf540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7220 expref: 7 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412679:0:7748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7220 expref: 6 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359422.412689:0:7748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:1.0:1788359422.412692:0:7748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788359422.412696:0:7748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0030600, rc 0) 00000100:00100000:1.0:1788359422.412837:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:12985:x1875230420219008:12345-192.168.202.52@tcp:101:lsof.0 Request processed in 709us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359422.412845:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 257 00000100:00100000:2.0:1788359423.164871:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445423360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359423.164980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359423.169453:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423360 00000100:00100000:1.0:1788359423.169474:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423360 00000100:00100000:1.0:1788359423.169584:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788359423.169595:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445423360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359423.169647:0:7937:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359423.169870:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445423360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 276us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359423.169898:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788359423.172939:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445423360:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788359423.357335:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359423.678115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445423488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359423.678218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359423.678422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423488 00000100:00100000:1.0:1788359423.678432:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423488 00000100:00100000:1.0:1788359423.678541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788359423.678553:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445423488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359423.678602:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788359423.678680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445423488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359423.678688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788359423.678755:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445423488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788359424.382834:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788359424.403522:0:15007:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:30:23 (1788359423) 00010000:00010000:3.0:1788359425.404712:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359425.726841:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359425.726868:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445423616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359425.726935:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.726954:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445423744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359425.727073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359425.727090:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423616 00000100:00100000:2.0:1788359425.727095:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359425.727098:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423616 00000100:00100000:2.0:1788359425.727100:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445423872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359425.727135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359425.727226:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359425.727240:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445424000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359425.727701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359425.729812:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423744 00000100:00100000:1.0:1788359425.729826:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423744 00000100:00100000:1.0:1788359425.729872:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445423872 00000100:00100000:1.0:1788359425.729875:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445423872 00000100:00100000:1.0:1788359425.729901:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788359425.729910:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445423616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359425.729955:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788359425.730021:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445423616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.730028:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788359425.730043:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788359425.730050:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445423744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359425.730077:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788359425.730119:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445423744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.730126:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788359425.730137:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788359425.730143:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445423872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359425.730152:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788359425.730193:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445423872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.730199:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788359425.730200:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445423744:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788359425.730217:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788359425.730220:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359425.730222:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1788359425.730226:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1788359425.730243:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445423872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359425.730291:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445424256:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730324:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730348:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445424768:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.730348:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445424512:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730400:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445425280:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.730416:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730432:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359425.730433:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445425024:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730448:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788359425.730452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730453:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445424384:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730482:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359425.730488:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445423616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359425.730513:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445424896:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.730515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788359425.730519:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445424128:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359425.730541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730557:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424256 00000100:00100000:2.0:1788359425.730562:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424256 00000100:00100000:1.0:1788359425.730567:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445424640:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730582:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424768 00000100:00100000:2.0:1788359425.730584:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424768 00000100:00100000:1.0:1788359425.730587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424512 00000100:00100000:1.0:1788359425.730602:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445425152:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730603:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424512 00000100:00100000:2.0:1788359425.730612:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425024 00000100:00100000:2.0:1788359425.730614:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425024 00000100:00100000:1.0:1788359425.730620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359425.730624:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424896 00000100:00100000:2.0:1788359425.730626:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424896 00000100:00100000:2.0:1788359425.730637:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425152 00000100:00100000:2.0:1788359425.730644:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425152 00000100:00100000:1.0:1788359425.730646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788359425.730653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445424256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730658:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788359425.730663:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445424768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730685:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445424768:12345-0@lo:400:kworker.0 Request processed in 21us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.730685:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445424256:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359425.730692:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788359425.730694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788359425.730704:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788359425.730707:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788359425.730709:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445424512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.730712:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445425024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730741:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445424512:12345-0@lo:400:kworker.0 Request processed in 26us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359425.730746:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788359425.730758:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788359425.730774:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445424896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.730800:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445424896:12345-0@lo:400:kworker.0 Request processed in 37us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359425.730805:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788359425.730816:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788359425.730821:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445425152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.730920:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445425024:12345-0@lo:400:kworker.0 Request processed in 207us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.730927:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788359425.730949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424128 00000100:00100000:1.0:1788359425.730953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424128 00000100:00100000:1.0:1788359425.730979:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788359425.730984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445424128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.731009:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445424128:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.731015:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788359425.731038:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424384 00000100:00100000:1.0:1788359425.731040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424384 00000100:00100000:1.0:1788359425.731058:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424640 00000100:00100000:1.0:1788359425.731060:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424640 00000100:00100000:1.0:1788359425.731069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788359425.731074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445424384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.731099:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445424384:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.731104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788359425.731113:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788359425.731131:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445424640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.731153:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445424640:12345-0@lo:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.731158:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788359425.731180:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445424128:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.731188:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445424640:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.737346:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445424000 00000100:00100000:0.0:1788359425.737351:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425280 00000100:00100000:1.0:1788359425.737361:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445424000 00000100:00100000:0.0:1788359425.737361:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425280 00000100:00100000:1.0:1788359425.737428:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788359425.737440:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445424000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788359425.737442:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788359425.737456:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445425280:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788359425.737470:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359425.739001:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875230445425152:12345-0@lo:400:kworker.0 Request processed in 8113us (8313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359425.739014:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788359425.739090:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445424384:0@lo:400:kworker.0 00010000:00080000:2.0:1788359425.739109:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead28df800 x1875230445424896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788359425.739121:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359425.739122:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445424896:0@lo:400:kworker.0 00000100:00080000:3.0:1788359425.739128:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359425.739131:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359425.739217:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445424768:0@lo:400:kworker.0 00000100:00100000:2.0:1788359425.739233:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445424256:0@lo:400:kworker.0 00000100:00100000:0.0:1788359425.739890:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445425280:12345-0@lo:400:kworker.0 Request processed in 2435us (9454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359425.739899:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788359425.739933:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445424000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2495us (12231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359425.739941:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:1.0:1788359425.739978:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead28df100 x1875230445425152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359425.740028:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445425280:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.740054:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445425152:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.740070:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445424512:0@lo:400:kworker.0 00000100:00100000:1.0:1788359425.740080:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445425024:0@lo:400:kworker.0 00000100:00100000:3.0:1788359425.740310:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445424000:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788359426.240649:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788359426.240667:0:6494:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788359426.240981:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788359426.240993:0:6547:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788359426.424997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359426.425098:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420219264 00000100:00100000:2.0:1788359426.425108:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420219264 00000100:00080000:3.0:1788359426.425167:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359426.425180:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 66 00000100:00100000:2.0:1788359426.425191:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+18:13209:x1875230420219264:12345-192.168.202.52@tcp:35:umount.0 00000100:00100000:2.0:1788359426.425432:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+19:13209:x1875230420219264:12345-192.168.202.52@tcp:35:umount.0 Request processed in 243us (443us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788359426.425440:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 66 00010000:00010000:1.0:1788359426.429151:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359426.429663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.429816:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420219520 00000100:00100000:1.0:1788359426.429825:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420219520 00000100:00100000:1.0:1788359426.430077:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:1.0:1788359426.430098:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+19:13209:x1875230420219520:12345-192.168.202.52@tcp:35:umount.0 00000100:00100000:1.0:1788359426.430367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+20:13209:x1875230420219520:12345-192.168.202.52@tcp:35:umount.0 Request processed in 270us (708us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788359426.430379:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 67 00000100:00100000:3.0:1788359426.434887:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359426.434953:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420219776 00000100:00100000:2.0:1788359426.434963:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420219776 00000100:00100000:2.0:1788359426.435013:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:2.0:1788359426.435024:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead0d90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+20:13209:x1875230420219776:12345-192.168.202.52@tcp:35:umount.0 00000100:00100000:2.0:1788359426.435226:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead0d90450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+21:13209:x1875230420219776:12345-192.168.202.52@tcp:35:umount.0 Request processed in 203us (346us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788359426.435235:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 68 00000100:00100000:2.0:1788359426.437274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.437359:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220032 00000100:00100000:1.0:1788359426.437368:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220032 00000100:00100000:1.0:1788359426.437419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:1.0:1788359426.437428:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+21:13209:x1875230420220032:12345-192.168.202.52@tcp:35:umount.0 00000100:00100000:1.0:1788359426.437734:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+22:13209:x1875230420220032:12345-192.168.202.52@tcp:35:umount.0 Request processed in 296us (455us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788359426.437743:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 69 00000100:00100000:1.0:1788359426.444395:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.444435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.444570:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.445104:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359426.445146:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220544 00000100:00100000:1.0:1788359426.445156:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220544 00000100:00100000:1.0:1788359426.445235:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 81 00000100:00100000:1.0:1788359426.445247:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2401:x1875230420220544:12345-192.168.202.52@tcp:9:umount.0 00000020:00000080:1.0:1788359426.445280:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae83c 00000100:00080000:1.0:1788359426.445287:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c77e3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359426.445333:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788359426.445691:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10b7ecde-1562-4877-be1f-e5861af40d5e+2:2401:x1875230420220544:12345-192.168.202.52@tcp:9:umount.0 Request processed in 446us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359426.445700:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 81 00010000:00010000:1.0:1788359426.445753:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788359426.446138:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359426.446417:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220416 00000100:00100000:0.0:1788359426.446424:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220416 00000100:00100000:3.0:1788359426.446518:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220160 00000100:00100000:3.0:1788359426.446524:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220160 00000100:00100000:0.0:1788359426.446573:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220288 00000100:00100000:0.0:1788359426.446577:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220288 00000100:00100000:0.0:1788359426.446605:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:0.0:1788359426.446612:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+15:2402:x1875230420220416:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359426.446625:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359426.446651:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14be00/0x49dd053b5feae771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e4c expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.446668:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359426.446701:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+14:2402:x1875230420220416:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 89us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359426.446708:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:0.0:1788359426.446735:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359426.446741:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+13:2402:x1875230420220160:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359426.446749:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359426.446769:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056a00/0x49dd053b5feae51e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d73 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.446779:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359426.446797:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:2402:x1875230420220160:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 57us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359426.446804:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359426.446817:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:0.0:1788359426.446822:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2402:x1875230420220288:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359426.446829:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359426.446838:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40400/0x49dd053b5feae461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d34 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.446846:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359426.446860:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+10:2402:x1875230420220288:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 39us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359426.446866:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:1.0:1788359426.450726:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359426.450829:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420220928 00000100:00100000:2.0:1788359426.450839:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420220928 00000100:00100000:2.0:1788359426.450904:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 82 00000100:00100000:2.0:1788359426.450915:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+7:2401:x1875230420220928:12345-192.168.202.52@tcp:9:umount.0 00000020:00000080:2.0:1788359426.450958:0:8431:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feaeaab 00000020:00010000:2.0:1788359426.450966:0:8431:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0ead2211000: total 0 00000100:00080000:2.0:1788359426.450969:0:8431:0:(import.c:65:import_set_state_nolock()) ffffa0ead2217000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788359426.450987:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1788359426.451017:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:3.0:1788359426.451026:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0ead2211000: total 0 00010000:00010000:3.0:1788359426.451073:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0ead2211000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788359426.451139:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002682b73f/0x49dd053b5feaee6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7036 expref: 5 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359426.451172:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10b7ecde-1562-4877-be1f-e5861af40d5e+4:2401:x1875230420220928:12345-192.168.202.52@tcp:9:umount.0 Request processed in 259us (465us total) trans 0 rc 0/0 00010000:00010000:3.0:1788359426.451176:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff3f6963/0x49dd053b5feaf539 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7219 expref: 4 pid: 8882 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359426.451185:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 82 00010000:00010000:3.0:1788359426.451273:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0ead2211000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788359426.451287:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359426.451289:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359426.451398:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359426.463613:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359426.466652:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420221952 00000100:00100000:3.0:1788359426.466667:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420221952 00000100:00100000:3.0:1788359426.466814:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 258 00000100:00100000:3.0:1788359426.466825:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+22:2401:x1875230420221952:12345-192.168.202.52@tcp:39:umount.0 00000020:00000080:3.0:1788359426.466856:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae46f 00000020:00010000:3.0:1788359426.466873:0:6517:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0e9c7458000: total 0 00000100:00080000:3.0:1788359426.466879:0:6517:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7459800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788359426.466910:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788359426.467105:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10b7ecde-1562-4877-be1f-e5861af40d5e+21:2401:x1875230420221952:12345-192.168.202.52@tcp:39:umount.0 Request processed in 282us (3501us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788359426.467113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 258 00000020:00010000:0.0:1788359426.467170:0:10394:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0e9c7458000: total 0 00010000:00010000:0.0:1788359426.467234:0:10394:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0e9c7458000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788359426.467278:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359426.467282:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359426.467289:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feaed4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6fe9 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467318:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eacc5acd00) 00010000:00010000:0.0:1788359426.467321:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359426.467325:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6e00/0x49dd053b5feae79b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e5a expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467341:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359426.467343:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788359426.467346:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea000/0x49dd053b5feaeeef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7059 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467357:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359426.467359:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788359426.467362:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feaf524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7212 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467372:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359426.467374:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788359426.467377:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7000/0x49dd053b5feae812 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e76 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467387:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffffa0ead14aac00) 00010000:00010000:0.0:1788359426.467401:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788359426.467406:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eba00/0x49dd053b5feaf1dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7132 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467421:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359426.467424:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359426.467427:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6a00/0x49dd053b5feaf4fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7204 expref: 14 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467437:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:0.0:1788359426.467440:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359426.467443:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eae00/0x49dd053b5feaeed3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7052 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467453:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eacc5ac700) 00010000:00010000:0.0:1788359426.467456:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359426.467460:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7a00/0x49dd053b5feae7b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e61 expref: 12 pid: 10096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467473:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359426.467475:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359426.467479:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feaee2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7021 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467489:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffffa0ead279f400) 00010000:00010000:0.0:1788359426.467491:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788359426.467518:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb800/0x49dd053b5feaee55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e702f expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467546:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffffa0eac5324c00) 00010000:00010000:0.0:1788359426.467548:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788359426.467553:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7800/0x49dd053b5feaeb0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6f4f expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467569:0:10394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffffa0ead27a2400) 00010000:00010000:0.0:1788359426.467571:0:10394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359426.467574:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7200/0x49dd053b5feaf41a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e71cc expref: 8 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359426.467588:0:10394:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0e9c7458000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788359426.467603:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359426.467606:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359426.467607:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359426.479137:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359426.479246:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222080 00000100:00100000:0.0:1788359426.479255:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222080 00000100:00100000:0.0:1788359426.479380:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 259 00000100:00100000:0.0:1788359426.479392:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+5:2401:x1875230420222080:12345-192.168.202.52@tcp:39:umount.0 00000020:00000080:0.0:1788359426.479423:0:7748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae476 00000100:00080000:0.0:1788359426.479440:0:7748:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7459000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788359426.479471:0:7748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788359426.479650:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10b7ecde-1562-4877-be1f-e5861af40d5e+3:2401:x1875230420222080:12345-192.168.202.52@tcp:39:umount.0 Request processed in 260us (522us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788359426.479659:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 259 00000100:00080000:1.0:1788359426.479721:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788359426.480960:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359427.185307:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359427.185360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359427.185470:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359427.185622:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222208 00000100:00100000:2.0:1788359427.185633:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222208 00000100:00100000:2.0:1788359427.185858:0:10335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222336 00000100:00100000:2.0:1788359427.185863:0:10335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222336 00000100:00100000:3.0:1788359427.186035:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222464 00000100:00100000:3.0:1788359427.186047:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222464 00000100:00100000:1.0:1788359427.186274:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:1.0:1788359427.186288:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+12:2403:x1875230420222208:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359427.186306:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359427.186324:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02057800/0x49dd053b5feae572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d88 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359427.186344:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359427.186369:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:3.0:1788359427.186383:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2403:x1875230420222336:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359427.186399:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788359427.186405:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+11:2403:x1875230420222208:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 118us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359427.186416:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00010000:00010000:3.0:1788359427.186422:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feae579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6db9 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359427.186455:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359427.186474:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:1.0:1788359427.186485:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:2403:x1875230420222464:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359427.186551:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788359427.186564:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+9:2403:x1875230420222336:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 184us (1202us total) trans 0 rc 0/0 00010000:00010000:1.0:1788359427.186571:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feae76a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6e45 expref: 9 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359427.186582:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00010000:00010000:1.0:1788359427.186597:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359427.186627:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+7:2403:x1875230420222464:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 143us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359427.186636:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:1.0:1788359427.198930:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359427.199096:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222720 00000100:00100000:3.0:1788359427.199110:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222720 00000100:00100000:3.0:1788359427.199217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 260 00000100:00100000:3.0:1788359427.199230:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+6:2401:x1875230420222720:12345-192.168.202.52@tcp:39:umount.0 00000020:00000080:3.0:1788359427.199287:0:6516:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae587 00000020:00010000:3.0:1788359427.199298:0:6516:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0e9c6354000: total 0 00000100:00080000:3.0:1788359427.199304:0:6516:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6355000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788359427.199339:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:2.0:1788359427.199356:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0e9c6354000: total 0 00010000:00010000:2.0:1788359427.199367:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359427.199441:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0e9c6354000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788359427.199482:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead14aae00) 00010000:00010000:2.0:1788359427.199486:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359427.199549:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac0030600/0x49dd053b5feaf547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7220 expref: 5 pid: 7748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359427.199579:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eacee332-d1ce-4046-a685-c3d51a3ce37d+4:2401:x1875230420222720:12345-192.168.202.52@tcp:39:umount.0 Request processed in 349us (661us total) trans 4294967528 rc 0/0 00010000:00010000:2.0:1788359427.199580:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0e9c6354000, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1788359427.199597:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 260 00010000:00010000:2.0:1788359427.199606:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359427.199612:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359427.199614:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788359427.199714:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788359427.208457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359427.208703:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420222848 00000100:00100000:1.0:1788359427.208717:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420222848 00000100:00080000:3.0:1788359427.208795:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359427.208846:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 261 00000100:00100000:1.0:1788359427.208857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+5:2401:x1875230420222848:12345-192.168.202.52@tcp:39:umount.0 00000020:00000080:1.0:1788359427.208908:0:6517:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae58e 00000100:00080000:1.0:1788359427.208919:0:6517:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6352800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359427.208945:0:6517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788359427.209182:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eacee332-d1ce-4046-a685-c3d51a3ce37d+3:2401:x1875230420222848:12345-192.168.202.52@tcp:39:umount.0 Request processed in 327us (738us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788359427.209191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 261 00010000:00010000:0.0:1788359427.209345:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359427.233173:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359427.233481:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223104 00000100:00100000:3.0:1788359427.233652:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223104 00000100:00100000:3.0:1788359427.233727:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 391 00000100:00100000:3.0:1788359427.233737:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+7:2401:x1875230420223104:12345-192.168.202.52@tcp:251:umount.0 00000020:00000080:3.0:1788359427.233976:0:6508:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae44c 00000020:00010000:3.0:1788359427.233988:0:6508:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0eaff1c7000: total 0 00000100:00080000:3.0:1788359427.233993:0:6508:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1c5800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788359427.234145:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51c1d10b-f267-4ee9-bf88-d15c1428dfcb+3:2401:x1875230420223104:12345-192.168.202.52@tcp:251:umount.0 Request processed in 408us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359427.234174:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 391 00000020:00010000:2.0:1788359427.237921:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0eaff1c7000: total 0 00010000:00010000:2.0:1788359427.238038:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0eaff1c7000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788359427.238098:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b400/0x49dd053b5feae525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e6d7a expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359427.238140:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0eaff1c7000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788359427.238154:0:6504:0:(genops.c:906:class_export_put()) final put ffffa0eaff1c7000/51c1d10b-f267-4ee9-bf88-d15c1428dfcb 00010000:00010000:2.0:1788359427.238173:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359427.238175:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359427.238177:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788359427.238213:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1c7000/51c1d10b-f267-4ee9-bf88-d15c1428dfcb for MGS 00000020:00000080:0.0:1788359427.238395:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaff1c5800 for MGS 00010000:00010000:2.0:1788359427.452782:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788359427.453459:0:13802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788359428.284646:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359428.284679:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445425408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359428.284878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359428.285114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425408 00000100:00100000:1.0:1788359428.285122:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425408 00000100:00100000:1.0:1788359428.285167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788359428.285177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445425408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359428.285211:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788359428.285259:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445425408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359428.285266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788359428.285310:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445425408:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1788359428.471462:0:15202:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:0.0:1788359428.478657:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788359428.484380:0:15202:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788359428.484435:0:15202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484450:0:15202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484459:0:15202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484467:0:15202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484485:0:15202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788359428.484490:0:15202:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788359428.484537:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359428.484543:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484552:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14ae00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359428.484556:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484582:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359428.484590:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359428.484597:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788359428.484599:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788359428.484602:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788359428.484634:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.484641:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359428.484992:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.485000:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ae00/0x49dd053b5feae4f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.485011:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359428.485013:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359428.485015:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788359428.485029:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359428.485033:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788359428.485038:0:15202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788359428.485051:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788359428.485102:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445425536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359428.485164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359428.485233:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445425664:0@lo:39:umount.0 00000100:00100000:3.0:1788359428.485777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359428.485813:0:7748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425664 00000100:00100000:3.0:1788359428.485820:0:7748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425664 00000100:00100000:3.0:1788359428.485868:0:7748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788359428.485876:0:7748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875230445425664:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788359428.485902:0:7748:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae063 00000100:00080000:3.0:1788359428.485909:0:7748:0:(import.c:65:import_set_state_nolock()) ffffa0ead27c9000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788359428.485966:0:7748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3641:x1875230445425664:12345-0@lo:39:umount.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359428.485973:0:7748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788359428.485982:0:7748:0:(genops.c:906:class_export_put()) final put ffffa0ead27ce800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788359428.486007:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788359428.486015:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27ce800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788359428.486055:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0ead27c9000 for lustre-MDT0000 00000100:00080000:3.0:1788359428.486085:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788359428.486094:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445425664:0@lo:39:umount.0 00000100:00100000:2.0:1788359428.486335:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425536 00000100:00100000:2.0:1788359428.486339:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425536 00000100:00100000:2.0:1788359428.486376:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359428.486393:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+24:3644:x1875230445425536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359428.486404:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359428.486419:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40a00/0x49dd053b5feae4fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4f4 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.486434:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359428.486470:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3644:x1875230445425536:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359428.486477:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788359428.486489:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445425536:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788359428.486518:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359428.486522:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788359428.486526:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788359428.488516:0:15202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488533:0:15202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488542:0:15202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488549:0:15202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488579:0:15202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788359428.488586:0:15202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488593:0:15202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488611:0:15202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488618:0:15202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.488634:0:15202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788359428.488944:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359428.488952:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.488961:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41000 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359428.488973:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.488980:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359428.488985:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359428.488989:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788359428.488991:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788359428.488992:0:10394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788359428.489016:0:10394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.489020:0:10394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359428.489040:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.489045:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41000/0x49dd053b5feae406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae40d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.489055:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359428.489056:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359428.489057:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359428.489062:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359428.489074:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445425792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359428.489117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359428.489167:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425792 00000100:00100000:3.0:1788359428.489174:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425792 00000100:00100000:3.0:1788359428.489230:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359428.489300:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3644:x1875230445425792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359428.489313:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359428.489327:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a200/0x49dd053b5feae40d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae406 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489338:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359428.489380:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:3644:x1875230445425792:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359428.489388:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359428.489404:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445425792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359428.489534:0:15202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489542:0:15202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489548:0:15202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489554:0:15202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489569:0:15202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359428.489576:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359428.489580:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489585:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebe00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359428.489588:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489599:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359428.489605:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359428.489609:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788359428.489611:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788359428.489613:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788359428.489624:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.489630:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359428.489644:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489758:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788359428.489764:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489770:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14ac00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359428.489772:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489778:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359428.489783:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359428.489788:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788359428.489790:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788359428.489803:0:6504:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489808:0:6504:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359428.489814:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489830:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14ac00/0x49dd053b5feae502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359428.489839:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359428.489841:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359428.489843:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359428.489972:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445425920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359428.490004:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359428.490040:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788359428.490046:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445426048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359428.490063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359428.490089:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445425920 00000100:00100000:1.0:1788359428.490092:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445425920 00000100:00100000:1.0:1788359428.490117:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426048 00000100:00100000:1.0:1788359428.490119:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426048 00000100:00100000:1.0:1788359428.490133:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359428.490139:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+23:3642:x1875230445425920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359428.490145:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359428.490154:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feae763 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae75c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.490162:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359428.490184:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+22:3642:x1875230445425920:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359428.490188:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359428.490207:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359428.490214:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+21:3642:x1875230445426048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359428.490222:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359428.490232:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b000/0x49dd053b5feae509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae502 expref: 21 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.490242:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359428.490264:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3642:x1875230445426048:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359428.490269:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359428.490300:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445426048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359428.490306:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3642:1875230445425920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359428.490341:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebe00/0x49dd053b5feae75c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae763 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.490354:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359428.490355:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359428.490357:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359428.490368:0:15202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.490375:0:15202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.490380:0:15202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.490396:0:15202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359428.490411:0:15202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788359428.490415:0:15202:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788359428.490418:0:15202:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788359428.490433:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359428.490439:0:10394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.490445:0:10394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb0217e400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359428.490447:0:10394:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788359428.490450:0:15202:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:1.0:1788359428.490454:0:10394:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788359428.490456:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 10000000:00010000:1.0:1788359428.490463:0:10394:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788359428.490464:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:01000000:1.0:1788359428.490470:0:10394:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00000080:3.0:1788359428.490472:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 10000000:01000000:1.0:1788359428.490472:0:10394:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788359428.490475:0:10394:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00080000:3.0:1788359428.490481:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0e9c7128800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788359428.490488:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0eaf6f6d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788359428.490490:0:10394:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.490510:0:10394:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1788359428.490526:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0eaf6d77000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788359428.490527:0:10394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359428.490534:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0eaf22a7000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:1.0:1788359428.490540:0:10394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb0217e400/0x49dd053b5feadfc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feadfc9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359428.490546:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffffa0e9c6354000 eacee332-d1ce-4046-a685-c3d51a3ce37d 192.168.202.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788359428.490555:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffffa0e9c7458000 10b7ecde-1562-4877-be1f-e5861af40d5e 192.168.202.52@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788359428.490559:0:15202:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffffa0eaf58d19c0) has exports, disconnecting them 00000020:00080000:3.0:1788359428.490563:0:15202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0e9c7128800), last request at 1788359425 00000020:00000080:3.0:1788359428.490569:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae373 00000100:00080000:3.0:1788359428.490585:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712f000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788359428.490608:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359428.490616:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359428.490618:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359428.490625:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1788359428.490635:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0e9c7128800): rc 0 00000100:00100000:1.0:1788359428.490636:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445426176:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788359428.490640:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0e9c7128800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:1.0:1788359428.490661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359428.490680:0:7465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426176 00000100:00100000:1.0:1788359428.490683:0:7465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426176 00000100:00100000:1.0:1788359428.490714:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788359428.490755:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788359428.490780:0:15202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0eaf6f6d800), last request at 1788359425 00000020:00000080:3.0:1788359428.490784:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae24d 00000100:00080000:3.0:1788359428.490790:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f6c000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788359428.490844:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7128800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788359428.490882:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c712f000 for lustre-MDT0000 00000020:00080000:3.0:1788359428.490897:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaf6f6d800): rc 0 00000020:00000080:3.0:1788359428.490899:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f6d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788359428.490905:0:15202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0eaf6d77000), last request at 1788359208 00000020:00000080:3.0:1788359428.490908:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae14a 00000100:00080000:3.0:1788359428.490912:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6d71000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788359428.490934:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+20:3645:x1875230445426176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359428.490945:0:7465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359428.490955:0:7465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac41c00/0x49dd053b5feadfc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feadfc2 expref: 20 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359428.490967:0:7465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359428.491001:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3645:x1875230445426176:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359428.491009:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788359428.491068:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445426176:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788359428.491546:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f6d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788359428.491658:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf6f6c000 for lustre-MDT0000 00010000:00010000:2.0:1788359428.493401:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359428.493465:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788359428.493487:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaf6d77000): rc 0 00000020:00000080:3.0:1788359428.493620:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eaf6d77000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788359428.493642:0:15202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0eaf22a7000), last request at 1788359208 00000020:00000080:3.0:1788359428.493648:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae119 00000020:00000080:1.0:1788359428.493727:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6d77000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1788359428.493794:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f6d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788359428.493816:0:15202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788359428.493885:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaf22a7000): rc 0 00000004:00000080:3.0:1788359428.493892:0:15202:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb78b4793fae0 00000100:00080000:3.0:1788359428.493909:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788359428.493912:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788359428.494974:0:15202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788359428.494999:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e4800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788359428.495038:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426304:0@lo:39:umount.0 00000100:00100000:3.0:1788359428.495099:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359428.495423:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359428.495604:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426304 00000100:00100000:2.0:1788359428.495612:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426304 00000100:00100000:2.0:1788359428.495665:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788359428.495673:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875230445426304:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788359428.495697:0:7937:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae1ba 00000100:00080000:2.0:1788359428.495703:0:7937:0:(import.c:65:import_set_state_nolock()) ffffa0eae4d1a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788359428.495718:0:7937:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788359428.495851:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3641:x1875230445426304:12345-0@lo:39:umount.0 Request processed in 178us (752us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788359428.495859:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00010000:2.0:1788359428.495877:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788359428.495900:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e4800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788359428.495906:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426304:0@lo:39:umount.0 00000100:00080000:3.0:1788359428.496078:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788359428.496082:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1788359428.496099:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788359428.496161:0:15202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788359428.496172:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0e9c559a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788359428.496189:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788359428.496192:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788359428.496214:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788359428.496381:0:15202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788359428.496392:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7417000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788359428.496417:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa0eaf58d19c0) has no exports 00000100:00100000:2.0:1788359428.496483:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426432:0@lo:9:umount.0 00000100:00100000:2.0:1788359428.496537:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359428.496561:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426560:0@lo:9:umount.0 00000100:00100000:2.0:1788359428.496582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359428.496611:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426432 00000100:00100000:2.0:1788359428.496622:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426432 00000100:00100000:2.0:1788359428.496669:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426560 00000100:00100000:2.0:1788359428.496673:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426560 00000100:00100000:2.0:1788359428.496694:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788359428.496700:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875230445426432:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788359428.496715:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2f5 00000100:00080000:2.0:1788359428.496721:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5607800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788359428.496770:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788359428.496850:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3641:x1875230445426432:12345-0@lo:9:umount.0 Request processed in 150us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359428.496857:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788359428.496870:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359428.496876:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875230445426560:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788359428.496887:0:8430:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae437 00000100:00080000:2.0:1788359428.496893:0:8430:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1c1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788359428.496915:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788359428.496977:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3641:x1875230445426560:12345-0@lo:9:umount.0 Request processed in 101us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359428.496984:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788359428.497003:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359428.497006:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359428.497028:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c559a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788359428.497036:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788359428.497038:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359428.497041:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426432:0@lo:9:umount.0 00000100:00080000:2.0:1788359428.497049:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c7417000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788359428.497054:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788359428.497056:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359428.497058:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445426560:0@lo:9:umount.0 00010000:00010000:2.0:1788359428.497087:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359428.497091:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788359428.497217:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf6d71000 for lustre-MDT0000 00000020:00080000:3.0:1788359428.507124:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa0eaf58d19c0) has no exports 00000020:00000080:3.0:1788359428.543984:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae01d 00000020:00000080:3.0:1788359428.544000:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eb006a5800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788359428.544056:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788359428.544122:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359428.544132:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788359428.544136:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffffa0eaf59319c0) has no exports 00000020:00000080:2.0:1788359428.544459:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae016 00000020:00000080:2.0:1788359428.544464:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eb0068f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788359428.544490:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb006a5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788359428.544786:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb0068f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788359428.544849:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359428.544856:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788359428.544859:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eb0068f000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788359428.544862:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb0068f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788359428.544868:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:2.0:1788359428.796785:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445426688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359428.796855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359428.796908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426688 00000100:00100000:3.0:1788359428.796917:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426688 00000100:00100000:3.0:1788359428.796959:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788359428.796967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875230445426688:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788359428.796974:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788359428.797017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3645:x1875230445426688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (162us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788359428.797023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:02020000:2.0:1788359428.797454:0:3645:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1788359428.804679:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788359428.804688:0:3645:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788359428.804693:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788359428.813728:0:3645:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359428.813754:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 240 00000100:00080000:2.0:1788359428.813764:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0eafec21800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359428.813846:0:3645:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0eaffba4700 x1875230445426816/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788359428.814082:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445426816:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788359428.814147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359428.814246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426816 00000100:00100000:1.0:1788359428.814255:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426816 00000100:00100000:1.0:1788359428.814294:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788359428.814316:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445426816:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788359428.814333:0:6520:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788359428.819669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445426816:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5343us (5511us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359428.819684:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1788359428.820295:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788359428.820303:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788359428.820307:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445426816:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1788359429.502395:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359430.530651:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788359430.844679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788359430.844687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359430.844703:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359430.844710:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 460 00000100:00080000:2.0:1788359430.844728:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359430.844735:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0eafec21800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359430.844756:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0eaffba4700 x1875230445427200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359430.844804:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445426944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359430.844907:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445427072:0@lo:400:kworker.0 00000100:00100000:3.0:1788359430.844958:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445427328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788359430.844966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359430.844999:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445427712:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845024:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359430.845046:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788359430.845050:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445428096:0@lo:400:kworker.0 00000100:00100000:3.0:1788359430.845067:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359430.845075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359430.845100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445427840:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845108:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427072 00000100:00100000:1.0:1788359430.845114:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427072 00000100:00100000:3.0:1788359430.845139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359430.845152:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788359430.845160:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3643:x1875230445427072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359430.845169:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788359430.845177:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445427456:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845206:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf25afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a40c955-5ca1-4b36-8930-3bb8957fb20c+19:3643:x1875230445427072:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359430.845217:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788359430.845218:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359430.845243:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445427968:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845264:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427712 00000100:00100000:1.0:1788359430.845269:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427712 00000100:00100000:3.0:1788359430.845270:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359430.845304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428096 00000100:00100000:3.0:1788359430.845309:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428096 00000100:00100000:1.0:1788359430.845314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427456 00000100:00100000:1.0:1788359430.845320:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427456 00000100:00100000:3.0:1788359430.845343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427968 00000100:00100000:1.0:1788359430.845348:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788359430.845350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427968 00000100:00100000:1.0:1788359430.845360:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445427712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845395:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875230445427712:12345-0@lo:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359430.845407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788359430.845421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788359430.845427:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445428096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845455:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445428096:12345-0@lo:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359430.845460:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788359430.845473:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788359430.845476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875230445427456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788359430.845482:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788359430.845531:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875230445427456:12345-0@lo:400:kworker.0 Request processed in 52us (316us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788359430.845537:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788359430.845549:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788359430.845552:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875230445427968:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788359430.845556:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788359430.845579:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875230445427968:12345-0@lo:400:kworker.0 Request processed in 24us (310us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788359430.845584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00080000:1.0:1788359430.845619:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead28de680 x1875230445428096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359430.845632:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445428096:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845643:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445427072:0@lo:400:kworker.0 00010000:00080000:1.0:1788359430.845652:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffba5f80 x1875230445427712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359430.845683:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3643:1875230445427712:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.845833:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427328 00000100:00100000:1.0:1788359430.845837:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427328 00000100:00100000:1.0:1788359430.845866:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788359430.845873:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445427328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359430.845895:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788359430.845906:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359430.845913:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359430.845933:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445427328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359430.845942:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788359430.845944:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427840 00000100:00100000:2.0:1788359430.845949:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427840 00000100:00100000:2.0:1788359430.845987:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788359430.845996:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445427840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.846006:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445427200:0@lo:38:kworker.0 00000100:00100000:2.0:1788359430.846323:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445427840:12345-0@lo:400:kworker.0 Request processed in 328us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359430.846330:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1788359430.846346:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359430.848009:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788359430.848024:0:3644:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788359430.848027:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788359430.850866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359430.850923:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445427584:0@lo:400:kworker.0 00000100:00100000:0.0:1788359430.850958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359430.851015:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427584 00000100:00100000:0.0:1788359430.851023:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427584 00000100:00100000:0.0:1788359430.851063:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788359430.851069:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875230445427584:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788359430.851076:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788359430.851116:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3642:x1875230445427584:12345-0@lo:400:kworker.0 Request processed in 45us (156us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788359430.851122:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788359430.851157:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788359430.851162:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788359430.851165:0:3642:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788359430.851170:0:3642:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359430.851175:0:3642:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 259 00000100:00080000:0.0:1788359430.851181:0:3642:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0e9c5598800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359430.851220:0:3642:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0eaffb84700 x1875230445428224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359430.851238:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445427584:0@lo:400:kworker.0 00000100:00100000:1.0:1788359430.851361:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359430.851387:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445428224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788359430.851409:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359430.851433:0:7937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445427200 00000100:00100000:0.0:1788359430.851438:0:7937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445427200 00000100:00100000:1.0:1788359430.851442:0:10096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428224 00000100:00100000:1.0:1788359430.851447:0:10096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428224 00000100:00100000:0.0:1788359430.851469:0:7937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788359430.851477:0:7937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875230445427200:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788359430.851478:0:10096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788359430.851487:0:10096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875230445428224:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788359430.851515:0:7937:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1788359430.851519:0:10096:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788359430.851551:0:10096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1875230445428224:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 64us (141us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359430.851556:0:10096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788359430.851581:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359430.851585:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359430.851588:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445428224:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788359430.851659:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445426944 00000100:00100000:2.0:1788359430.851665:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445426944 00000100:00100000:2.0:1788359430.851703:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788359430.851723:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445426944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359430.851752:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788359430.851804:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445426944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359430.851810:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788359430.851843:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445426944:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788359430.857072:0:3644:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359430.857081:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 240 00000100:00080000:3.0:1788359430.857090:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa0eaf95e5000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359430.857125:0:3644:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74ff480 x1875230445428352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359430.857185:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445428352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788359430.857266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359430.857344:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428352 00000100:00100000:2.0:1788359430.857351:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428352 00000100:00100000:2.0:1788359430.857389:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788359430.857394:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788359430.857420:0:6516:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788359430.857466:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445427456:0@lo:400:kworker.0 00000100:00080000:3.0:1788359430.857487:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788359430.857490:0:3644:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788359430.857492:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788359430.857514:0:3644:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359430.857516:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 281 00000100:00080000:3.0:1788359430.857520:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0e9c712d800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359430.857801:0:3644:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74ff800 x1875230445428480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359430.857851:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445428480:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788359430.857871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359430.857922:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 526us (654us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359430.857930:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788359430.857947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428480 00000100:00100000:2.0:1788359430.857951:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428480 00000100:00100000:2.0:1788359430.857971:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788359430.857976:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428480:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788359430.857984:0:6516:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788359430.858011:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428480:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 34us (138us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359430.858018:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788359430.858092:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445427968:0@lo:400:kworker.0 00000100:00100000:3.0:1788359430.858120:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445427328:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359430.858131:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445427840:0@lo:400:kworker.0 00000100:00080000:1.0:1788359430.858340:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359430.858344:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359430.858346:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445428352:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788359430.858357:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359430.858359:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359430.858360:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445428480:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788359430.884053:0:7937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875230445427200:12345-0@lo:38:kworker.0 Request processed in 32567us (32682us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788359430.884067:0:7937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1788359430.884584:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359430.884592:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359430.884596:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445427200:0@lo:38:kworker.0 00010000:00010000:2.0:1788359431.548756:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788359431.870538:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788359431.870554:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788359431.870560:0:7445:0:(genops.c:906:class_export_put()) final put ffffa0eafee4c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788359431.870574:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00080000:3.0:1788359431.870583:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788359431.870585:0:7445:0:(genops.c:906:class_export_put()) final put ffffa0e9c6353000/eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00100000:3.0:1788359431.870589:0:7445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000001:00080000:3.0:1788359431.870592:0:7445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788359431.870594:0:7445:0:(genops.c:906:class_export_put()) final put ffffa0e9c7458800/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:2.0:1788359431.870620:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eafee4c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000001:00100000:3.0:1788359431.870635:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788359431.870639:0:6494:0:(genops.c:906:class_export_put()) final put ffffa0eaf22a7000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788359431.870647:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00080000:3.0:1788359431.870653:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788359431.870655:0:6494:0:(genops.c:906:class_export_put()) final put ffffa0e9c6354000/eacee332-d1ce-4046-a685-c3d51a3ce37d 00000001:00100000:3.0:1788359431.870662:0:6494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000001:00080000:3.0:1788359431.870667:0:6494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788359431.870682:0:6494:0:(genops.c:906:class_export_put()) final put ffffa0e9c7458000/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:2.0:1788359431.870686:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6353000/eacee332-d1ce-4046-a685-c3d51a3ce37d for lustre-MDT0001 00000001:00100000:1.0:1788359431.870727:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788359431.870732:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0e9c5604800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788359431.870735:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7458800/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-MDT0001 00000001:00100000:1.0:1788359431.870745:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:1.0:1788359431.870749:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0ead2211000/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:2.0:1788359431.870768:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eae4d1a800 for lustre-MDT0001 00000020:00000080:2.0:1788359431.870772:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf22a7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788359431.870799:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6354000/eacee332-d1ce-4046-a685-c3d51a3ce37d for lustre-MDT0000 00000020:00000080:2.0:1788359431.870817:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7458000/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-MDT0000 00000020:00000080:2.0:1788359431.870837:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c6352800 for lustre-MDT0001 00000020:00000080:2.0:1788359431.870840:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c5604800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788359431.870858:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c7459000 for lustre-MDT0001 00000020:00000080:2.0:1788359431.870861:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead2211000/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-OST0000 00000020:00000080:2.0:1788359431.870871:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf6f6d000 for lustre-MDT0000 00000020:00000080:2.0:1788359431.870873:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c6355000 for lustre-MDT0000 00000020:00000080:2.0:1788359431.870876:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c7459800 for lustre-MDT0000 00000020:00000080:2.0:1788359431.870884:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c5607800 for lustre-OST0000 00000020:00000080:2.0:1788359431.870886:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0ead2217000 for lustre-OST0000 00000001:00100000:0.0:1788359431.871939:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788359431.871945:0:9510:0:(genops.c:906:class_export_put()) final put ffffa0eaff1c6000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788359431.871970:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:0.0:1788359431.871972:0:9510:0:(genops.c:906:class_export_put()) final put ffffa0e9c77e6800/10b7ecde-1562-4877-be1f-e5861af40d5e 00000020:00000080:2.0:1788359431.872094:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788359431.872130:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c77e6800/10b7ecde-1562-4877-be1f-e5861af40d5e for lustre-OST0001 00000020:00000080:2.0:1788359431.872146:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaff1c1800 for lustre-OST0001 00000020:00000080:2.0:1788359431.872150:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c77e3000 for lustre-OST0001 00010000:00010000:2.0:1788359432.573219:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359433.598255:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359434.620877:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788359434.621211:0:15202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eaff2210c0 - data ffffa0e9c5848bd0/ffffa0eaff1d1c00 00000020:01000000:0.0:1788359434.621300:0:15202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eac710e9c0 - data ffffa0eae5195e58/ffffa0eb00534c00 00000001:00000004:0.0:1788359434.629890:0:15202:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788359434.681316:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788359434.681325:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788359434.681340:0:15202:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa0e9c74fc700 x1875230445426304/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788359438 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359434.681358:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788359434.682565:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788359434.682570:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1788359434.682635:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359434.682639:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788359434.682844:0:8879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788359434.682848:0:8879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788359434.682856:0:8879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788359434.683351:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788359434.683353:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788359434.683369:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359434.683370:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788359434.683534:0:9983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788359434.683538:0:9983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788359434.683546:0:9983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788359434.685904:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadfe5 00000020:00000080:1.0:1788359434.685917:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27cd800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788359434.687211:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27cd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788359434.687399:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadffa 00000020:00000080:1.0:1788359434.687405:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27cc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788359434.687419:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788359434.687424:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.687433:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788359434.687438:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffffa0eaf58d0000) has no exports 00000020:00000080:2.0:1788359434.687445:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27cc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788359434.687631:0:15202:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788359434.687641:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae430 00000020:00000080:1.0:1788359434.687645:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0e9c7416800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788359434.687662:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788359434.687666:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.687688:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788359434.687692:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffffa0eafef7b380) has no exports 00000020:00000080:1.0:1788359434.687697:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae429 00000020:00000080:1.0:1788359434.687702:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0e9c7410800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788359434.687727:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7416800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788359434.687740:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7410800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788359434.688147:0:15202:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788359434.688152:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788359434.688157:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788359434.688162:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359434.688165:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788359434.688212:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.688221:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359434.688231:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2ee 00000020:00000080:1.0:1788359434.688243:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0e9c6315000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788359434.688247:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788359434.688251:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359434.688254:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c7417000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788359434.688256:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788359434.688261:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffffa0eaffa43380) has no exports 00000020:00000080:2.0:1788359434.688264:0:37:0:(genops.c:906:class_export_put()) final put ffffa0eaffa8f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788359434.688266:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2e7 00000020:00000080:2.0:1788359434.688268:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa8f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788359434.688271:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0e9c559d000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788359434.688275:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788359434.688362:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6315000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788359434.688372:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c559d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788359434.688752:0:15202:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788359434.688756:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788359434.688758:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:1.0:1788359434.688761:0:15202:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359434.688762:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788359434.688801:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.688807:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788359434.688820:0:15202:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788359434.688826:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae1b3 00000020:00000080:1.0:1788359434.688831:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eafef9f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788359434.688835:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788359434.688838:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.688842:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788359434.688845:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffffa0eafef7cd40) has no exports 00000020:00000080:1.0:1788359434.688849:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae1ac 00000020:00000080:1.0:1788359434.688852:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eaf95e4000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788359434.688902:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c559a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788359434.688911:0:38:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f6f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788359434.688921:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f6f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788359434.688928:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788359434.688994:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eafef9f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788359434.689004:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf95e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788359434.692759:0:15202:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788359434.692768:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788359434.692772:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788359434.692780:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788359434.692816:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf95e4800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788359434.692839:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.692854:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359434.692860:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eafef98800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788359434.692865:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eafef98800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788359434.692872:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359434.693002:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.693007:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359434.693010:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27ca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788359434.693013:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27ca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788359434.693017:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788359434.693074:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae001 00000020:00000080:1.0:1788359434.693081:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27cc000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788359434.693087:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788359434.693090:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.693095:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788359434.693098:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffffa0eaf58d3380) has no exports 00000020:00000080:1.0:1788359434.693117:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.693121:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788359434.693126:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae008 00000020:00000080:1.0:1788359434.693129:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27cd000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788359434.693137:0:15202:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eae4e42000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788359434.693140:0:15202:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eae4e42000 3 00000020:01000004:1.0:1788359434.693143:0:15202:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0eae4e42000 from lustre-MDT0000 00000020:00000080:1.0:1788359434.693160:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.693163:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788359434.693166:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0ead27c8000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788359434.693168:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27c8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788359434.693173:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788359434.693203:0:15202:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788359434.693207:0:15202:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788359434.693210:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788359434.693212:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.693215:0:15202:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788359434.693221:0:15202:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffffa0eae546c000 8a40c955-5ca1-4b36-8930-3bb8957fb20c 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788359434.693226:0:15202:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffffa0eaf5934d40) has exports, disconnecting them 00000020:00080000:1.0:1788359434.693230:0:15202:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0eae546c000), last request at 1788359189 00000020:00000080:1.0:1788359434.693243:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadfa6 00000020:00010000:1.0:1788359434.693252:0:15202:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0eae546c000: total 2 00000100:00080000:1.0:1788359434.693256:0:15202:0:(import.c:65:import_set_state_nolock()) ffffa0eae546c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788359434.693272:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eae546c000): rc 0 00000020:00080000:1.0:1788359434.693276:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffffa0eaf5934d40) has no exports 00000100:00100000:1.0:1788359434.693328:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0eac71ad200:6509] 1 exiting: rc = 0 00000020:00010000:2.0:1788359434.693382:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0eae546c000: total 2 00010000:00010000:2.0:1788359434.693428:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0eae546c000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788359434.693439:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0eafac42800:6510] 2 exiting: rc = 0 00010000:00010000:2.0:1788359434.693473:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056c00/0x49dd053b5feae4df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4d8 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359434.693516:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14aa00/0x49dd053b5feae4d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4ca expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359434.693519:0:6508:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0eac71ade00:6508] 0 exiting: rc = 1 00010000:00010000:2.0:1788359434.693540:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb0217fc00/0x49dd053b5feae0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae0a9 expref: 12 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359434.693557:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eb02056800/0x49dd053b5feae739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae732 expref: 11 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693567:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693572:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feae747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae740 expref: 10 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693580:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788359434.693590:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27cc000/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:2.0:1788359434.693590:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14bc00/0x49dd053b5feae4ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4e6 expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693595:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788359434.693599:0:38:0:(genops.c:906:class_export_put()) final put ffffa0ead27c8800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788359434.693602:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27c8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788359434.693607:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:1.0:1788359434.693611:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693614:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feae0a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae09b expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693623:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693632:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031600/0x49dd053b5feae3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae3c0 expref: 7 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693642:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693658:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693663:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14ba00/0x49dd053b5feae517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae510 expref: 6 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788359434.693671:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead27cd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788359434.693691:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693693:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14a400/0x49dd053b5feae4a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4a0 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693705:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1788359434.693718:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaff14b800/0x49dd053b5feae755 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae74e expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693729:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693739:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693748:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693756:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693766:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788359434.693769:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feae4b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4ae expref: 3 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693779:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788359434.693786:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eafac40200/0x49dd053b5feae4c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x49dd053b5feae4bc expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359434.693795:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788359434.693807:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0eae546c000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1788359434.693807:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693820:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788359434.693829:0:6503:0:(genops.c:906:class_export_put()) final put ffffa0eae546c000/8a40c955-5ca1-4b36-8930-3bb8957fb20c 00000100:00100000:1.0:1788359434.693834:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693843:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788359434.693845:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359434.693849:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359434.693854:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359434.693855:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788359434.693858:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eae546c000/8a40c955-5ca1-4b36-8930-3bb8957fb20c for MGS 00000100:00100000:1.0:1788359434.693868:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693878:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693886:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693896:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693907:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788359434.693917:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eae546c800 for MGS 00000100:00100000:1.0:1788359434.693921:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693934:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693953:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693961:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693968:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693974:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693982:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693989:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.693996:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694004:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694012:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694019:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694028:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694036:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694044:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694050:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694058:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694065:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694070:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694078:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694087:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694094:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694101:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694108:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694114:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694120:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694126:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694132:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694141:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694151:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694161:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694169:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694177:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694182:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694192:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694198:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694204:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359434.694216:0:15202:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788359434.694948:0:15202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eaf6e9a120 - data ffffa0eae535a288/ffffa0e9c6a25800 00000020:01000000:1.0:1788359434.695094:0:15202:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eac2896420 - data ffffa0eae5046000/ffffa0eae4ca7000 00000020:00000080:1.0:1788359434.695620:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadf8a 00000020:00000080:1.0:1788359434.695625:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eac5e9c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788359434.695633:0:15202:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eae4e42000 from MGS, refs=2 00000020:01000004:1.0:1788359434.695636:0:15202:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eae4e42000 2 00000020:01000004:1.0:1788359434.695638:0:15202:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0eae4e42000 from MGS 00000020:00000080:3.0:1788359434.695645:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eac5e9c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788359434.695655:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.695659:0:15202:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788359434.695661:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eac5e9f800/MGS 00000020:00000080:1.0:1788359434.695663:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eac5e9f800/MGS for MGS 00000020:01000000:1.0:1788359434.695668:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788359434.695734:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788359434.695737:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.695740:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788359434.695744:0:15202:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0eb006a6800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788359434.695748:0:15202:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffffa0eaf5933380) has exports, disconnecting them 00000020:00080000:1.0:1788359434.695751:0:15202:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0eb006a6800), last request at 1788359190 00000020:00000080:1.0:1788359434.695754:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae055 00000020:00080000:1.0:1788359434.695762:0:15202:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eb006a6800): rc 0 00000020:00000080:1.0:1788359434.695766:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eb006a6800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788359434.695838:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb006a6800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788359434.702601:0:15202:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788359434.702608:0:15202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359434.702612:0:15202:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788359434.702618:0:15202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788359434.702659:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eb0068c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788359434.702773:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.702782:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788359434.702787:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eb006a2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788359434.702791:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb006a2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788359434.702804:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788359434.702885:0:15202:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eae4e42000 1 00000020:00000080:1.0:1788359434.702890:0:15202:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadf7c 00000020:00000080:1.0:1788359434.702895:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eac5e9f000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788359434.702900:0:15202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788359434.702904:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359434.702908:0:15202:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788359434.702911:0:15202:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffffa0eaf58d4d40) has no exports 00000020:00000080:3.0:1788359434.702954:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eac5e9f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788359434.748269:0:15202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359434.748279:0:15202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788359434.748283:0:15202:0:(genops.c:906:class_export_put()) final put ffffa0eac4a88800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788359434.748286:0:15202:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eac4a88800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788359434.748290:0:15202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788359434.748389:0:15202:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0eae4e41000 00000020:02000400:1.0:1788359434.748437:0:15202:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788359435.645376:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359435.964710:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445428608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359435.964777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359435.964814:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428608 00000100:00100000:2.0:1788359435.964821:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428608 00000100:00100000:2.0:1788359435.964885:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788359435.964895:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445428608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359435.964923:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788359435.964967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445428608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359435.964975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788359435.965022:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359435.965551:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445428608:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788359435.965618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788359435.965622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359435.965625:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359435.965630:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:2.0:1788359435.965635:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788359435.965640:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0eafec21800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359435.965655:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445428736:0@lo:400:kworker.0 00000100:00100000:2.0:1788359435.965660:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28df100 x1875230445428864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788359435.965690:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230445428736 offset 0 length 224: 4 00000100:00080000:2.0:1788359435.965694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788359435.965697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359435.965699:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359435.965702:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 462 00000100:00080000:2.0:1788359435.965705:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359435.965708:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa0eaf95e5000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359435.965721:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28df480 x1875230445428992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359435.965730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788359435.965739:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359435.965741:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359435.965745:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 462 00000100:00100000:0.0:1788359435.965756:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445428864:0@lo:38:kworker.0 00000100:00080000:2.0:1788359435.965759:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359435.965763:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0e9c5598800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359435.965776:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28dd500 x1875230445429120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359435.965787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788359435.965795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788359435.965798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359435.965800:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359435.965803:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 462 00000100:00080000:2.0:1788359435.965805:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359435.965808:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0e9c712d800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359435.965819:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28dd180 x1875230445429376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359435.965850:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445428992:0@lo:38:kworker.0 00000100:00100000:2.0:1788359435.965862:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445429248:0@lo:400:kworker.0 00000100:00100000:0.0:1788359435.965873:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359435.965886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359435.965892:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445429120:0@lo:38:kworker.0 00000100:00100000:2.0:1788359435.965910:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445429504:0@lo:400:kworker.0 00000100:00100000:0.0:1788359435.965911:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359435.965925:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445429376:0@lo:38:kworker.0 00000100:00100000:2.0:1788359435.965931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359435.965947:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359435.965949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359435.965952:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445429632:0@lo:400:kworker.0 00000100:00100000:2.0:1788359435.965973:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359435.965998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428864 00000100:00100000:1.0:1788359435.966002:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428864 00000100:00100000:2.0:1788359435.966010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445428992 00000100:00100000:2.0:1788359435.966013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445428992 00000100:00100000:2.0:1788359435.966024:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429248 00000100:00100000:1.0:1788359435.966027:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788359435.966031:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429248 00000100:00100000:1.0:1788359435.966032:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875230445428864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788359435.966049:0:6521:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788359435.966067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429120 00000100:00100000:2.0:1788359435.966070:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429120 00000100:00100000:2.0:1788359435.966080:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429504 00000100:00100000:2.0:1788359435.966082:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429504 00000100:00100000:1.0:1788359435.966084:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875230445428864:12345-0@lo:38:kworker.0 Request processed in 51us (297us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359435.966090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788359435.966095:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429376 00000100:00100000:2.0:1788359435.966097:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429376 00000100:00100000:2.0:1788359435.966105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788359435.966109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788359435.966110:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445429248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359435.966120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359435.966169:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429632 00000100:00100000:0.0:1788359435.966173:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429632 00000100:00100000:0.0:1788359435.966203:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788359435.966209:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445429632:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788359435.966328:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788359435.966335:0:6511:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788359435.966345:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359435.966356:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445429760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359435.966407:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445429248:12345-0@lo:400:kworker.0 Request processed in 296us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359435.966409:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445429632:12345-0@lo:400:kworker.0 Request processed in 201us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359435.966414:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788359435.966415:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788359435.966429:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788359435.966432:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428992:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788359435.966442:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788359435.966466:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445428992:12345-0@lo:38:kworker.0 Request processed in 32us (592us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359435.966471:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788359435.966481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788359435.966485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445429120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788359435.966509:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788359435.966533:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445429120:12345-0@lo:38:kworker.0 Request processed in 46us (621us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359435.966538:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788359435.966549:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788359435.966552:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445429376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788359435.966560:0:6516:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788359435.966588:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445429376:12345-0@lo:38:kworker.0 Request processed in 35us (638us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359435.966594:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788359435.966646:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445429632:0@lo:400:kworker.0 00000100:00100000:1.0:1788359435.967094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445429504:12345-0@lo:400:kworker.0 Request processed in 974us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359435.967102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:1.0:1788359435.967139:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359435.967144:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359435.967148:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445429120:0@lo:38:kworker.0 00000100:00080000:1.0:1788359435.967157:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359435.967160:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359435.967162:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445429376:0@lo:38:kworker.0 00010000:00080000:2.0:1788359435.967164:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa0ead28dfb80 x1875230445429504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359435.967169:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359435.967172:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788359435.967174:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445429504:0@lo:400:kworker.0 00000100:00100000:1.0:1788359435.967175:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445428864:0@lo:38:kworker.0 00000100:00080000:1.0:1788359435.967182:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359435.967185:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359435.967188:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445428992:0@lo:38:kworker.0 00000100:00100000:2.0:1788359435.968489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359435.968590:0:10901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429760 00000100:00100000:1.0:1788359435.968599:0:10901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429760 00010000:00080000:2.0:1788359435.968660:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffffa0ead28ddf80 x1875230445429248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359435.968672:0:10901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788359435.968682:0:10901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445429760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788359435.968713:0:10901:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788359435.968731:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445429248:0@lo:400:kworker.0 00000100:00100000:1.0:1788359435.968773:0:10901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445429760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359435.968783:0:10901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788359435.968787:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445429760:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788359436.669745:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788359436.740130:0:15403:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788359436.756680:0:15403:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788359436.756793:0:15403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.756809:0:15403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.756818:0:15403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.756826:0:15403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.756847:0:15403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788359436.756852:0:15403:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788359436.756879:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359436.756883:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788359436.756888:0:15403:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788359436.756894:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95e5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788359436.756898:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359436.756900:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788359436.756903:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788359436.757867:0:15403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757878:0:15403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757885:0:15403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757904:0:15403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757916:0:15403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788359436.757921:0:15403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757928:0:15403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757933:0:15403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757939:0:15403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757955:0:15403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788359436.757960:0:15403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757966:0:15403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757972:0:15403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757979:0:15403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.757995:0:15403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1788359436.758000:0:15403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.758007:0:15403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.758013:0:15403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.758019:0:15403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359436.758026:0:15403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:1.0:1788359436.758029:0:15403:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1788359436.758049:0:15403:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1788359436.758053:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1788359436.758056:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359436.758061:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788359436.758068:0:15403:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffffa0e9c712f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788359436.758073:0:15403:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffffa0eaff384000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788359436.758078:0:15403:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffffa0eaece10000) has exports, disconnecting them 00000020:00080000:1.0:1788359436.758082:0:15403:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa0e9c712f800), last request at 1788359435 00000020:00000080:1.0:1788359436.758088:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae388 00000100:00080000:1.0:1788359436.758107:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788359436.758147:0:15403:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0e9c712f800): rc 0 00000020:00000080:1.0:1788359436.758149:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0e9c712f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1788359436.758159:0:15403:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffffa0eaff384000), last request at 1788359435 00000020:00000080:1.0:1788359436.758167:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae262 00000100:00080000:1.0:1788359436.758173:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6314000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788359436.758180:0:15403:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaff384000): rc 0 00000020:00000080:1.0:1788359436.758181:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaff384000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1788359436.758188:0:15403:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb78b40f67ae0 00000100:00080000:1.0:1788359436.758203:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359436.758211:0:15403:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffffa0e9c80ec000 x1875230445426688/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788359444 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359436.758223:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1788359436.759072:0:15403:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788359436.759077:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0eafec21800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:3.0:1788359436.759272:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788359436.759280:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759290:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0030800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359436.759293:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759302:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359436.759308:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359436.759314:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788359436.759316:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788359436.759319:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788359436.759355:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759361:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359436.759384:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759391:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feae4d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759415:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788359436.759418:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759424:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359436.759427:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759434:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359436.759440:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359436.759445:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788359436.759448:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1788359436.759449:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1788359436.759474:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759480:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359436.759612:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759620:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40800/0x49dd053b5feae4e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae4ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759630:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788359436.759634:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759645:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359436.759648:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759666:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359436.759673:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359436.759679:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788359436.759681:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788359436.759683:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788359436.759697:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759703:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359436.759709:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759714:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41600/0x49dd053b5feae3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae3c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759727:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359436.759731:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759736:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a000 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359436.759738:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759750:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359436.759756:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359436.759761:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788359436.759763:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788359436.759765:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788359436.759775:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759781:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359436.759786:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759792:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a000/0x49dd053b5feae74e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae755 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759801:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359436.759804:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759810:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02057c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359436.759812:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759818:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359436.759834:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359436.759839:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788359436.759841:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788359436.759843:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788359436.759856:0:6503:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759862:0:6503:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788359436.759867:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759873:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02057c00/0x49dd053b5feae0a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x49dd053b5feae0b0 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359436.759884:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359436.759886:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359436.759888:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359436.759908:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445430144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359436.759969:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359436.760028:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359436.760035:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445430016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359436.760055:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788359436.760078:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c712f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788359436.760115:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff384000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788359436.760138:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c712c800 for lustre-MDT0001 00000020:00000080:3.0:1788359436.760142:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c6314000 for lustre-MDT0001 00010000:00010000:0.0:1788359436.760213:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359436.760359:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359436.760373:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445429888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359436.760400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359436.760430:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445430400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359436.760447:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359436.760473:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445426688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359436.760489:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359436.760517:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445430272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359436.760538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359436.760629:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430144 00000100:00100000:2.0:1788359436.760636:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430144 00000100:00100000:2.0:1788359436.760679:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430016 00000100:00100000:2.0:1788359436.760683:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430016 00000100:00100000:2.0:1788359436.760692:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445429888 00000100:00100000:2.0:1788359436.760694:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445429888 00000100:00100000:2.0:1788359436.760701:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430400 00000100:00100000:2.0:1788359436.760703:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430400 00000100:00100000:2.0:1788359436.760710:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430272 00000100:00100000:2.0:1788359436.760712:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430272 00000100:00100000:2.0:1788359436.760723:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359436.760729:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875230445430144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788359436.760735:0:6500:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359436 with bad export cookie 5322416087192231846 00000100:00100000:3.0:1788359436.761320:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359436.761327:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875230445430016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788359436.761331:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359436 with bad export cookie 5322416087192231846 00000100:00100000:3.0:1788359436.761383:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3643:x1875230445430016:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1326us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788359436.761390:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359436.761410:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788359436.761414:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445429888:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788359436.761419:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359436 with bad export cookie 5322416087192231846 00000100:00100000:3.0:1788359436.761449:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445429888:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1049us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788359436.761455:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788359436.761466:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788359436.761471:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445430400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788359436.761474:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359436 with bad export cookie 5322416087192231846 00000100:00100000:3.0:1788359436.761514:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445430400:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (1066us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788359436.761520:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788359436.761532:0:7465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788359436.761536:0:7465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445430272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788359436.761540:0:7465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788359436 with bad export cookie 5322416087192231846 00000100:00100000:3.0:1788359436.761564:0:7465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875230445430272:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (1025us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788359436.761570:0:7465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788359436.761608:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788359436.761613:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788359436.761623:0:3643:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788359436.763627:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788359436.763635:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788359436.763699:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788359436.763775:0:15403:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788359436.763800:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1f7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788359436.763818:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788359436.763820:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788359436.763828:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359436.763902:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445430528:0@lo:9:umount.0 00000100:00100000:1.0:1788359436.763956:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359436.764003:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430528 00000100:00100000:1.0:1788359436.764009:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430528 00000100:00100000:1.0:1788359436.764054:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788359436.764062:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875230445430528:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788359436.764084:0:8433:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2af 00000100:00080000:1.0:1788359436.764092:0:8433:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f6f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359436.764128:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788359436.764273:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3641:x1875230445430528:12345-0@lo:9:umount.0 Request processed in 211us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359436.764281:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788359436.764312:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaff1f7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788359436.765391:0:15403:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788359436.765410:0:15403:0:(import.c:65:import_set_state_nolock()) ffffa0e9c745c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788359436.765440:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa0eaece10000) has no exports 00000004:00080000:1.0:1788359436.766855:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788359436.766861:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359436.766868:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445430528:0@lo:9:umount.0 00000100:00100000:1.0:1788359436.766897:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445430656:0@lo:9:umount.0 00000100:00100000:1.0:1788359436.766949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359436.766997:0:8882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445430656 00000100:00100000:1.0:1788359436.767004:0:8882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445430656 00000100:00100000:1.0:1788359436.767043:0:8882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788359436.767051:0:8882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875230445430656:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788359436.767072:0:8882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae3f1 00000100:00080000:1.0:1788359436.767081:0:8882:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa8b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788359436.767113:0:8882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788359436.767233:0:8882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3641:x1875230445430656:12345-0@lo:9:umount.0 Request processed in 183us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359436.767241:0:8882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1788359436.767260:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359436.767270:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788359436.767292:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c745c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788359436.767301:0:3641:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788359436.767303:0:3641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788359436.767305:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445430656:0@lo:9:umount.0 00000100:00080000:2.0:1788359436.769085:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788359436.779649:0:3643:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.152@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788359436.779666:0:3643:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788359436.779675:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0ead28dd880 x1875230445428736/t0(0) o400->MGC192.168.202.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788359451 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359436.779696:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c74fc700 x1875230445430144/t0(0) o103->MGC192.168.202.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788359452 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359436.779707:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c74ff100 x1875230445430016/t0(0) o103->MGC192.168.202.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788359452 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359436.779717:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c74fd500 x1875230445429888/t0(0) o103->MGC192.168.202.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788359452 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359436.779728:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c74ff480 x1875230445430400/t0(0) o103->MGC192.168.202.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788359452 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359436.779738:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3644:1875230445428736:0@lo:400:kworker.0 00000100:00100000:3.0:1788359436.779740:0:3643:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c74ff800 x1875230445430272/t0(0) o103->MGC192.168.202.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788359452 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788359436.779752:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788359436.779753:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa0eae546d000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788359436.779755:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875230445430144:12345-0@lo:103:ldlm_bl.0 Request processed in 19010us (19770us total) trans 0 rc -107/-107 00000100:00080000:3.0:1788359436.779756:0:3643:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788359436.779759:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788359436.779764:0:3643:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359436.779770:0:3643:0:(import.c:510:import_select_connection()) MGC192.168.202.152@tcp: connect to NID 0@lo last attempt 221 00000100:00100000:0.0:1788359436.779774:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359436.779775:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445429888:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788359436.779780:0:3643:0:(import.c:624:import_select_connection()) MGC192.168.202.152@tcp: import ffffa0eae546d000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359436.779792:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445430400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359436.779812:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3645:1875230445430272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359436.779847:0:3643:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9500 x1875230445430784/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788359436.779873:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445430144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359436.779886:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3643:1875230445430016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359436.779896:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445430784:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788359436.779938:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230445430784 offset 0 length 520: 4 00000020:00080000:1.0:1788359436.783931:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa0eaece10000) has no exports 00000020:01000000:0.0:1788359436.832680:0:15403:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eaff221b40 - data ffffa0e9c5848360/ffffa0eaff1d0c00 00000020:01000000:0.0:1788359436.832814:0:15403:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eac2db1f00 - data ffffa0eae5239000/ffffa0eaff03bc00 00000001:00000004:2.0:1788359436.843648:0:15403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788359436.867296:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359436.867304:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788359436.867311:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788359436.868400:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788359436.868403:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788359436.868414:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359436.868415:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788359436.868844:0:8873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788359436.868849:0:8873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788359436.868860:0:8873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788359436.869491:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788359436.869509:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788359436.869516:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359436.869518:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788359436.870415:0:9979:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788359436.870418:0:9979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788359436.870433:0:9979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788359436.871950:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae0cc 00000020:00000080:2.0:1788359436.871960:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f68800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788359436.872423:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f68800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788359436.873405:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae0e1 00000020:00000080:2.0:1788359436.873411:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f81000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788359436.873447:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788359436.873451:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.873457:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788359436.873460:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffffa0eaece14d40) has no exports 00000004:01000000:2.0:1788359436.873611:0:15403:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788359436.873619:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae3ea 00000020:00000080:2.0:1788359436.873622:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0e9c745f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788359436.873698:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f81000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788359436.873862:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788359436.873865:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c745f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788359436.873866:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.873874:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788359436.873877:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffffa0e9c6874d40) has no exports 00000020:00000080:2.0:1788359436.873883:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae3e3 00000020:00000080:2.0:1788359436.873888:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaff1f3800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788359436.874232:0:15403:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788359436.874236:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788359436.874241:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788359436.874246:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359436.874248:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788359436.874287:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.874295:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788359436.874300:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2a8 00000020:00000080:2.0:1788359436.874304:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaff1f6000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788359436.874307:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788359436.874310:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.874314:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788359436.874317:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffffa0eafed78000) has no exports 00000020:00000080:2.0:1788359436.874321:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae2a1 00000020:00000080:2.0:1788359436.874323:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaff1f0800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788359436.874639:0:15403:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788359436.874648:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788359436.874651:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788359436.874665:0:15403:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788359436.874668:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788359436.874693:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.874698:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788359436.874714:0:15403:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788359436.874719:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae104 00000020:00000080:2.0:1788359436.874723:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6cea000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788359436.874727:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788359436.874731:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.874734:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788359436.874736:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffffa0eae4d80000) has no exports 00000020:00000080:2.0:1788359436.874740:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae0fd 00000020:00000080:2.0:1788359436.874742:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f84000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788359436.875249:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1f3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788359436.875258:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c745c800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788359436.875264:0:37:0:(genops.c:906:class_export_put()) final put ffffa0e9c6316000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788359436.875266:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6316000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788359436.875277:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788359436.875351:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1f6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788359436.875356:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1f0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788359436.875359:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaff1f7000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788359436.875362:0:37:0:(genops.c:906:class_export_put()) final put ffffa0e9c6311000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788359436.875363:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c6311000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788359436.875365:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788359436.875384:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6cea000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788359436.875387:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f84000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788359436.885794:0:15403:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788359436.885802:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359436.885807:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788359436.885815:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788359436.885870:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eafec21800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788359436.885873:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.885886:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788359436.885891:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6ced800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788359436.885895:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6ced800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788359436.885903:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788359436.886049:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.886054:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788359436.886057:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f6e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788359436.886059:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f6e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788359436.886063:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788359436.886159:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae0e8 00000020:00000080:2.0:1788359436.886166:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f82000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788359436.886187:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788359436.886191:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.886196:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788359436.886200:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffffa0eaece119c0) has no exports 00000020:00000080:0.0:1788359436.886206:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f82000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788359436.886232:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.886237:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788359436.886240:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f69000/lustre-MDD0001_UUID 00000020:00000080:2.0:1788359436.886243:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f69000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788359436.886247:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1788359436.886399:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae0ef 00000020:00000080:2.0:1788359436.886404:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f85000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788359436.886418:0:15403:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaf6cef800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788359436.886422:0:15403:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6cef800 2 00000020:01000004:2.0:1788359436.886426:0:15403:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0eaf6cef800 from lustre-MDT0001 00000020:00000080:0.0:1788359436.886426:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f85000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788359436.886449:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.886453:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788359436.886456:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f69800/lustre-MDT0001_UUID 00000020:00000080:2.0:1788359436.886458:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f69800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788359436.886465:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788359436.886488:0:15403:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788359436.886492:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788359436.886514:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.886518:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788359436.886525:0:15403:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffffa0eb006a5000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788359436.886531:0:15403:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffffa0eafed799c0) has exports, disconnecting them 00000020:00080000:2.0:1788359436.886535:0:15403:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffffa0eb006a5000), last request at 1788359208 00000020:00000080:2.0:1788359436.886539:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae143 00000020:00080000:2.0:1788359436.886549:0:15403:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eb006a5000): rc 0 00000020:00000080:2.0:1788359436.886552:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eb006a5000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788359436.886570:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eb006a5000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788359436.891635:0:15403:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788359436.891644:0:15403:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359436.891665:0:15403:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788359436.891671:0:15403:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788359436.891749:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf95e5000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788359436.891815:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.891823:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788359436.891829:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf95cd800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788359436.891832:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf95cd800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788359436.891840:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788359436.891962:0:15403:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6cef800 1 00000020:00000080:2.0:1788359436.891968:0:15403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae07f 00000020:00000080:2.0:1788359436.891974:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0ead278f000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788359436.891990:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788359436.891994:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359436.891999:0:15403:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1788359436.891999:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead278f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:2.0:1788359436.892003:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffffa0eae4d84d40) has no exports 00000020:00000080:1.0:1788359436.921373:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359436.921386:0:15403:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788359436.921392:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf6cea800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788359436.921396:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6cea800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788359436.921407:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788359436.921549:0:15403:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0eaf6ced000 00000020:01000000:1.0:1788359436.921571:0:15403:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788359436.921575:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359436.921580:0:15403:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788359436.921583:0:15403:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffffa0eaece13380) has no exports 00000100:00100000:2.0:1788359436.921829:0:6516:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0eac328ac00:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1788359436.921830:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0ead0f22800:6517] 2 exiting: rc = 0 00000100:00100000:2.0:1788359436.921986:0:10096:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa0e9c7466800:10096] 4 exiting: rc = 0 00000100:00100000:3.0:1788359436.922000:0:7748:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0eaf6c99400:7748] 3 exiting: rc = 0 00000100:00100000:1.0:1788359436.922006:0:6515:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0eac71ac400:6515] 0 exiting: rc = 1 00000100:00100000:1.0:1788359436.922450:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922460:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922467:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922473:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922479:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922485:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922491:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922575:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922582:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922587:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922593:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922599:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922604:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922610:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922615:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922621:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922634:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922640:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922645:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922651:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922675:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922682:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922688:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922693:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922698:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922704:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922709:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922715:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922720:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922725:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922731:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922736:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922740:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922746:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922751:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922756:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922762:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922767:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922773:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922779:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922784:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922789:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922795:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922800:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922806:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922811:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922817:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922824:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922830:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922835:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922840:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922852:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922857:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922863:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922868:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922874:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922879:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922884:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922889:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922894:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922899:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922905:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922910:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.922921:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.926035:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0eac328a000:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1788359436.926046:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0eac328ec00:6519] 1 exiting: rc = 0 00000100:00100000:2.0:1788359436.926132:0:14274:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffffa0eaccd42000:14274] 2 exiting: rc = 0 00000100:00100000:0.0:1788359436.926206:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926213:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926219:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926225:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926231:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926236:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926250:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926256:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926261:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926267:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926274:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926280:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926287:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926302:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926308:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926314:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926318:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926322:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926325:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926329:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926332:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926335:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926339:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926341:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926344:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926347:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926350:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926353:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926356:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926360:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926363:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926365:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926368:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926371:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926374:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926377:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926380:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926382:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926385:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926388:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926391:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926394:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926397:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926400:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926403:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926406:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926409:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926411:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926419:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926423:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926426:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926429:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926432:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926436:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926439:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926442:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926445:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926448:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926451:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926454:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926456:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926459:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926462:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.926465:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.926837:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa0eac7770c00:6521] 1 exiting: rc = 0 00000100:00100000:2.0:1788359436.926872:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0eac4ff5600:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1788359436.926937:0:7937:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffffa0eafeef6200:7937] 2 exiting: rc = 0 00000100:00100000:2.0:1788359436.927048:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927058:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927065:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927074:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927080:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927085:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927091:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927096:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927102:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927107:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927113:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927118:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927124:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927148:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927153:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927159:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927165:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927170:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927176:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927182:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927189:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927197:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927236:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927243:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927250:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927271:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927279:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927284:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927290:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927296:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927303:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927309:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927315:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927321:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927326:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927331:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927337:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927359:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927396:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927403:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927408:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927414:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927419:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927424:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927429:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927434:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927440:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927446:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927460:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927474:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927479:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927484:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927487:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927771:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927778:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927781:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927785:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927789:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927793:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927797:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927801:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927805:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927808:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.927817:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.933361:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0eac7770800:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1788359436.934217:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa0eaf223aa00:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1788359436.934379:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934388:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934398:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934404:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934409:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934414:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934420:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934426:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934433:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934440:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934447:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934453:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934458:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934463:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934468:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934473:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934478:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934483:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934488:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934516:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934523:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934528:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934533:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934537:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934543:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934548:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934553:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934557:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934565:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934571:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934577:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934598:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934603:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934608:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934614:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934619:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934724:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934728:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934731:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934734:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934738:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934741:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934744:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934747:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934750:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934753:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934756:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934758:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934761:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934764:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934767:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934770:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934773:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934775:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934878:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934882:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934886:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934889:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934892:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934895:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934898:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934900:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934903:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.934906:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359436.935177:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0eaecdea000:6524] 0 exiting: rc = 1 00000100:00100000:0.0:1788359436.935223:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa0eaf223b800:6525] 1 exiting: rc = 0 00000100:00100000:3.0:1788359436.935432:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935436:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935446:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935449:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935453:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935456:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935459:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935462:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935465:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935469:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935472:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935474:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935478:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935481:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935484:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935488:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935491:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935589:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935596:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935602:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935608:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935613:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935618:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935701:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935707:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935711:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935716:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935721:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935725:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935730:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935735:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935739:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935743:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935749:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935754:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935759:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935764:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935779:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935784:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935788:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935792:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935797:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935801:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935806:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935810:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935814:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935819:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935823:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935828:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935833:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935838:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935843:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935847:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935851:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935856:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935862:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935867:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935872:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935877:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935883:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935891:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935896:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935900:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.935905:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359436.936563:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa0eacc5b0400:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788359436.936621:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0eaecdeb200:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1788359436.936693:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936700:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936705:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936710:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936715:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936719:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936723:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936729:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936741:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936938:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936947:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936951:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936955:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936958:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936961:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936964:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936968:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936971:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936974:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936977:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936979:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936983:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936985:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936988:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936991:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936995:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.936998:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937001:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937004:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937007:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937009:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937012:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937015:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937018:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937021:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937024:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937026:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937029:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937032:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937035:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937038:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937041:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.937043:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938791:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938795:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938798:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938802:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938805:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938808:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938812:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938815:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938818:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938821:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938823:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938826:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938829:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938832:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938834:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938837:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938841:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938844:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938847:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938851:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.938855:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359436.940308:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0eae4c0d200:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1788359436.940325:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0eae4c0c800:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1788359436.940753:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0eae4c0c000:6530] 2 exiting: rc = 0 00000100:00100000:3.0:1788359436.940833:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940840:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940846:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940852:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940857:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940862:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940868:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940874:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940879:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940883:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940888:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940893:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940898:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940903:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940921:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940926:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940946:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940952:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940957:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940962:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940968:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940973:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940978:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940983:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940989:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.940995:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941002:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941008:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941013:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941018:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941034:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941039:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941048:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941054:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941060:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941065:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941070:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941076:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941081:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941087:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941106:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941113:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941118:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941122:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941127:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941132:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941138:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941143:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941149:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941161:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941167:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941172:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941178:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941182:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941188:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941194:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941200:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941205:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941211:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941216:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941222:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941227:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941233:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359436.941239:0:15403:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788359436.945260:0:15403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359436.945272:0:15403:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788359436.945277:0:15403:0:(genops.c:906:class_export_put()) final put ffffa0eaf243a000/MDS_uuid 00000020:00000080:2.0:1788359436.945281:0:15403:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf243a000/MDS_uuid for MDS 00000020:01000000:2.0:1788359436.945292:0:15403:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788359436.945914:0:15403:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788359437.693868:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359438.720929:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788359439.388319:0:15604:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788359439.403643:0:15604:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788359439.403698:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359439.403712:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359439.403720:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359439.403728:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359439.403748:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788359439.403753:0:15604:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788359439.403792:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359439.403796:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788359439.403801:0:15604:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788359439.403807:0:15604:0:(import.c:65:import_set_state_nolock()) ffffa0e9c5598800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788359439.403811:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788359439.403813:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788359439.403816:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788359439.404549:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788359439.404554:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788359439.404559:0:15604:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788359439.404578:0:15604:0:(import.c:65:import_set_state_nolock()) ffffa0eaf243a800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788359439.404685:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445430912:0@lo:39:umount.0 00000400:00000100:2.0:1788359439.404725:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445430912 offset 0 length 224: 4 00010000:00010000:3.0:1788359439.405706:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359439.405716:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359439.405727:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaff14a800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:3.0:1788359439.405731:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359439.405740:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359439.405747:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359439.405752:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788359439.405755:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788359439.405757:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788359439.405771:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:3.0:1788359439.405787:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359439.405793:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaff14a800/0x49dd053b5feae4bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359439.405806:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359439.405807:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359439.405809:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359439.746725:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359440.764710:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788359441.087488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788359441.087527:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788359441.087530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788359441.087533:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788359441.087537:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359441.087545:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 467 00000100:00080000:0.0:1788359441.087551:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788359441.087557:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0e9c712d800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359441.087606:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8124a80 x1875230445431040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359441.087712:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445431040:0@lo:38:kworker.0 00000100:00100000:3.0:1788359441.087738:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445431168:0@lo:400:kworker.0 00000400:00000100:2.0:1788359441.087767:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445431040 offset 0 length 520: 4 00000400:00000100:3.0:1788359441.087771:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445431168 offset 0 length 224: 4 00010000:00010000:3.0:1788359441.788671:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359442.814383:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788359443.134139:0:8425:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788359443.134147:0:8425:0:(genops.c:906:class_export_put()) final put ffffa0eaf6f6e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788359443.134265:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf6f6e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788359443.134314:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf6f6f800 for lustre-OST0000 00000001:00100000:3.0:1788359443.134586:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788359443.134590:0:9510:0:(genops.c:906:class_export_put()) final put ffffa0eaffa8c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788359443.134651:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa8c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788359443.134677:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaffa8b000 for lustre-OST0001 00010000:00010000:0.0:1788359443.836853:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359444.860801:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359445.889364:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359446.207686:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359436/real 1788359436] req@ffffa0ead27b9500 x1875230445430784/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788359446 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359446.207720:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27b9500 x1875230445430784/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788359446 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359446.207726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359446.207732:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788359446.207735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359446.207743:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359446.207763:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788359446.207837:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788359446.207842:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445430784:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:3.0:1788359446.207858:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788359446.207883:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445431296:0@lo:400:kworker.0 00000400:00000100:3.0:1788359446.207933:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445431296 offset 0 length 224: 4 00000100:00080000:1.0:1788359446.210740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359446.210751:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788359446.210755:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788359446.210763:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.152@tcp: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1788359446.210770:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788359446.210779:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.152@tcp: import ffffa0eae546d000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359446.210829:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80efb80 x1875230445431424/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359446.210857:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359446.210862:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359446.210901:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445431424:0@lo:250:kworker.0 00000400:00000100:2.0:1788359446.210952:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230445431424 offset 0 length 520: 4 00010000:00010000:0.0:1788359446.910550:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359447.932681:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359448.956831:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359449.276633:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359439/real 1788359439] req@ffffa0e9c80eed80 x1875230445430912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788359449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359449.276672:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0e9c80eed80 x1875230445430912/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788359449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788359449.276691:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf243a800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788359449.276714:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445430912:0@lo:39:umount.0 00000100:00080000:1.0:1788359449.276965:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788359449.276970:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788359449.276975:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788359449.279028:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279045:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279052:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279059:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279086:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359449.279093:0:15604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279099:0:15604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279105:0:15604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359449.279124:0:15604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359449.279132:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359449.279140:0:15604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359449.279145:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359449.279146:0:15604:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788359449.279157:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359449.279161:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359449.279171:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788359449.279174:0:15604:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1788359449.279182:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1788359449.279182:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359449.279192:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788359449.279194:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788359449.279197:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788359449.279199:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359449.279210:0:6504:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:3.0:1788359449.279217:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eb02056400 already unused, calling callback (ffffffffc1124c20) 00010000:00010000:0.0:1788359449.279217:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359449.279222:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359449.279234:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40e00/0x49dd053b5feae4ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4d1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359449.279252:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788359449.279269:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359449.279275:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788359449.279278:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788359449.279279:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788359449.279280:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788359449.279285:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359449.279289:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359449.279290:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:3.0:1788359449.279295:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359449.279313:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056400/0x49dd053b5feae740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae747 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359449.279323:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359449.279325:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359449.279327:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788359449.281460:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788359449.281472:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359449.281482:0:15604:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788359449.281486:0:15604:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffffa0e9c561cd40) has no exports 00000020:00080000:1.0:1788359449.282711:0:15604:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffffa0e9c561cd40) has no exports 00000020:01000000:1.0:1788359449.284521:0:15604:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0e9c7258720 - data ffffa0eae533baf8/ffffa0e9c74a5000 00000020:01000000:1.0:1788359449.287562:0:15604:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eaf6e9a060 - data ffffa0eae52afca8/ffffa0eaf665f000 00100000:10000000:1.0:1788359449.297612:0:15604:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788359449.303170:0:15604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae21c 00000020:00000080:0.0:1788359449.303182:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0e9c5602800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788359449.303199:0:15604:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaf6d76800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788359449.303204:0:15604:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6d76800 2 00000020:01000004:0.0:1788359449.303207:0:15604:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0eaf6d76800 from lustre-OST0000 00000020:00000080:0.0:1788359449.303230:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788359449.303240:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788359449.303243:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0e9c5604000/lustre-OST0000_UUID 00000020:00000080:0.0:1788359449.303246:0:15604:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c5604000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788359449.303252:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788359449.303306:0:15604:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788359449.303311:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788359449.303315:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788359449.303320:0:15604:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788359449.303326:0:15604:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0e9c559f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788359449.303332:0:15604:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffffa0eafed7b380) has exports, disconnecting them 00000020:00080000:0.0:1788359449.303337:0:15604:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0e9c559f000), last request at 1788359227 00000020:00000080:0.0:1788359449.303341:0:15604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae246 00000020:00080000:0.0:1788359449.303349:0:15604:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0e9c559f000): rc 0 00000020:00000080:0.0:1788359449.303354:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0e9c559f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788359449.304054:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c5602800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788359449.304066:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c559f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788359449.314625:0:15604:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788359449.314634:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788359449.314638:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788359449.314646:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788359449.314881:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359449.314891:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788359449.314899:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788359449.314904:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359449.314908:0:15604:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788359449.314916:0:15604:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffffa0eaff384800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788359449.314923:0:15604:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffffa0eafed7cd40) has exports, disconnecting them 00000020:00080000:2.0:1788359449.314951:0:15604:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffffa0eaff384800), last request at 1788359227 00000020:00000080:2.0:1788359449.314955:0:15604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae25b 00000020:00080000:2.0:1788359449.314972:0:15604:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaff384800): rc 0 00000020:00000080:2.0:1788359449.314977:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0eaff384800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788359449.315789:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c5598800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788359449.315798:0:38:0:(genops.c:906:class_export_put()) final put ffffa0e9c559e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788359449.315800:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c559e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788359449.315812:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788359449.315870:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff384800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788359449.315896:0:15604:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788359449.315900:0:15604:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788359449.315903:0:15604:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788359449.315906:0:15604:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788359449.315943:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaf243a800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788359449.316068:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788359449.316075:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788359449.316078:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0e9c559b800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788359449.316080:0:15604:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c559b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788359449.316085:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788359449.316110:0:15604:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaf6d76800 1 00000020:00000080:3.0:1788359449.316115:0:15604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae1e4 00000020:00000080:3.0:1788359449.316120:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0eafef99000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788359449.316127:0:15604:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788359449.316134:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eafef99000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788359449.316142:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788359449.316146:0:15604:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788359449.316148:0:15604:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffffa0eae4d819c0) has no exports 00000020:00000080:3.0:1788359449.337697:0:15604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788359449.337711:0:15604:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788359449.337717:0:15604:0:(genops.c:906:class_export_put()) final put ffffa0ead278d000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788359449.337721:0:15604:0:(genops.c:865:class_export_destroy()) destroying export ffffa0ead278d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788359449.337731:0:15604:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788359449.337840:0:15604:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0eaf6d72000 00000020:02000400:3.0:1788359449.337886:0:15604:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788359449.981654:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359451.004882:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788359451.327827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359451.327837:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788359451.327840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359451.327844:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359451.330115:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445431552:0@lo:400:kworker.0 00000400:00000100:2.0:1788359451.330189:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445431552 offset 0 length 224: 4 00000020:01000004:3.0:1788359451.595596:0:15805:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788359451.601010:0:15805:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788359451.601070:0:15805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359451.601082:0:15805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359451.601087:0:15805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359451.601099:0:15805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359451.601115:0:15805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788359451.601120:0:15805:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788359451.601138:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359451.601144:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359451.601151:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac41e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359451.601155:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359451.601163:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359451.601174:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788359451.601175:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:1.0:1788359451.601180:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788359451.601182:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00100000:3.0:1788359451.601185:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c8124a80 x1875230445431040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788359461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788359451.601185:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788359451.601197:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:1.0:1788359451.601200:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359451.601201:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788359451.601206:0:15805:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788359451.601207:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac41e00/0x49dd053b5feae4a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788359451.601211:0:15805:0:(import.c:65:import_set_state_nolock()) ffffa0e9c712d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788359451.601215:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788359451.601218:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359451.601219:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c8124a80 x1875230445431040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788359461 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788359451.601220:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359451.601223:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359451.601226:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788359451.601231:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1788359451.601249:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445431040:0@lo:38:kworker.0 00000100:00080000:3.0:1788359451.602545:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788359451.602555:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c8127480 x1875230445431168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359457 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359451.602581:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c80ed880 x1875230445431296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359451.602590:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c80ed500 x1875230445431552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359467 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359451.602604:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788359451.602607:0:15805:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788359451.602628:0:15805:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa88000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788359451.602644:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3644:1875230445431552:0@lo:400:kworker.0 00000100:00100000:1.0:1788359451.602670:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445431296:0@lo:400:kworker.0 00000100:00100000:1.0:1788359451.602685:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445431168:0@lo:400:kworker.0 00000100:00100000:2.0:1788359451.602687:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445431680:0@lo:39:umount.0 00000400:00000100:2.0:1788359451.602743:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875230445431680 offset 0 length 224: 4 00010000:00010000:0.0:1788359452.030455:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359453.053488:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359454.076990:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359455.101240:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359456.128690:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788359456.444644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788359456.444655:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788359457.149061:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359458.173378:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359459.196966:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359460.220714:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359461.244759:0:10394:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788359461.564739:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359461.564750:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359461.820776:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359451/real 1788359451] req@ffffa0ead27b8380 x1875230445431680/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788359461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359461.820809:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27b8380 x1875230445431680/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788359461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359461.820820:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359446/real 1788359446] req@ffffa0e9c80efb80 x1875230445431424/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788359461 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359461.820831:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0e9c80efb80 x1875230445431424/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788359461 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788359461.820847:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa88000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788359461.820862:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445431680:0@lo:39:umount.0 00000100:00080000:2.0:1788359461.820877:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788359461.820894:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788359461.820898:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445431424:0@lo:250:kworker.0 00000100:00080000:3.0:1788359461.820911:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788359461.820915:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788359461.820919:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788359461.820980:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788359461.820986:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788359461.820989:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788359461.821000:0:38:0:(import.c:510:import_select_connection()) MGC192.168.202.152@tcp: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1788359461.821006:0:38:0:(import.c:589:import_select_connection()) MGC192.168.202.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788359461.821013:0:38:0:(import.c:624:import_select_connection()) MGC192.168.202.152@tcp: import ffffa0eae546d000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359461.821149:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80ed880 x1875230445431808/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359461.821205:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445431808:0@lo:250:kworker.0 00000400:00000100:2.0:1788359461.821250:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875230445431808 offset 0 length 520: 4 00010000:00010000:3.0:1788359461.822197:0:15805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822212:0:15805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822219:0:15805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822225:0:15805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822257:0:15805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359461.822264:0:15805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822272:0:15805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822279:0:15805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822285:0:15805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359461.822314:0:15805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788359461.822319:0:15805:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788359461.822345:0:15805:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:1.0:1788359461.822349:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000000:3.0:1788359461.822350:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788359461.822356:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788359461.822358:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788359461.822362:0:15805:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788359461.822369:0:15805:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffffa0eafef78000) has no exports 00010000:00010000:1.0:1788359461.822372:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eafac40600 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359461.822377:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822388:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788359461.822393:0:15805:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffffa0eafef78000) has no exports 10000000:00010000:1.0:1788359461.822404:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359461.822410:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788359461.822412:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788359461.822430:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788359461.822443:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:1.0:1788359461.822446:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822453:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40600/0x49dd053b5feae4ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822478:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359461.822523:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822531:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7e00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359461.822534:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822542:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359461.822549:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359461.822555:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788359461.822558:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788359461.822559:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788359461.822566:0:6503:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:1.0:1788359461.822569:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822575:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7e00/0x49dd053b5feae732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae739 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359461.822588:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359461.822590:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359461.822592:0:6503:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788359461.824064:0:15805:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0eaff2214e0 - data ffffa0eae51135e8/ffffa0eaff1d1400 00000020:01000000:3.0:1788359461.824152:0:15805:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0e9c72587e0 - data ffffa0eae5346948/ffffa0eaff0c3800 00010000:00010000:0.0:1788359461.824395:0:6504:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788359461.836813:0:15805:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788359461.842342:0:15805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae342 00000020:00000080:2.0:1788359461.842353:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaffa89000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788359461.842372:0:15805:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaff1c4000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788359461.842376:0:15805:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaff1c4000 2 00000020:01000004:2.0:1788359461.842379:0:15805:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0eaff1c4000 from lustre-OST0001 00000020:00000080:2.0:1788359461.842399:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359461.842408:0:15805:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788359461.842410:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaffa89800/lustre-OST0001_UUID 00000020:00000080:2.0:1788359461.842413:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa89800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788359461.842431:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788359461.842605:0:15805:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8a40c955-5ca1-4b36-8930-3bb8957fb20c->MGS 00010000:00010000:2.0:1788359461.842619:0:15805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eb02056e00/0x49dd053b5feae09b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359461.842630:0:15805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eb02056e00/0x49dd053b5feae09b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359461.842636:0:15805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788359461.842639:0:15805:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788359461.842642:0:15805:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788359461.842654:0:15805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:2.0:1788359461.842657:0:15805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eb02056e00/0x49dd053b5feae09b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae0a2 expref: -99 pid: 7444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359461.842668:0:15805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359461.842674:0:15805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359461.842685:0:15805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788359461.842687:0:15805:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788359461.842689:0:15805:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788359461.842700:0:15805:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0eae546d000 00010000:00010000:2.0:1788359461.842702:0:15805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eafac40000/0x49dd053b5feae510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x49dd053b5feae517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788359461.842716:0:15805:0:(import.c:65:import_set_state_nolock()) ffffa0eae546d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788359461.842720:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788359461.842722:0:15805:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788359461.842723:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788359461.842727:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788359461.842735:0:15805:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0e9c80ed880 x1875230445431808/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788359481 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788359461.842747:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788359461.842749:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00000020:00000080:1.0:1788359461.844478:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa89000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788359461.844626:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8a40c955-5ca1-4b36-8930-3bb8957fb20c:3641:1875230445431808:0@lo:250:kworker.0 10000000:01000000:2.0:1788359461.844721:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788359461.844732:0:15805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feadf98 00000020:00000080:2.0:1788359461.844739:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaf2439000/8a40c955-5ca1-4b36-8930-3bb8957fb20c 00000020:01000000:2.0:1788359461.844751:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.152@tcp (flags='') 00000020:00000080:2.0:1788359461.844756:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359461.844761:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaf2439000/8a40c955-5ca1-4b36-8930-3bb8957fb20c for MGC192.168.202.152@tcp 00000020:00000080:2.0:1788359461.844762:0:15805:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788359461.844768:0:15805:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffffa0eaf5930000) has no exports 10000000:01000000:0.0:1788359461.844799:0:6512:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788359461.844809:0:15805:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.152@tcp: client import never connected 00000100:00080000:2.0:1788359461.844814:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788359461.844816:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788359461.844818:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788359461.844820:0:15805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788359461.844847:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eae546d000 for MGC192.168.202.152@tcp 00000020:00000080:2.0:1788359461.844863:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788359461.844870:0:15805:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.152@tcp (uuid 8a40c955-5ca1-4b36-8930-3bb8957fb20c) 00000020:00000080:2.0:1788359461.844873:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eae5469000/8a40c955-5ca1-4b36-8930-3bb8957fb20c 00000020:00000080:2.0:1788359461.844887:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eae5469000/8a40c955-5ca1-4b36-8930-3bb8957fb20c for MGC192.168.202.152@tcp 00000020:01000000:2.0:1788359461.844893:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.152@tcp (8a40c955-5ca1-4b36-8930-3bb8957fb20c) 00000020:01000000:2.0:1788359461.845145:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788359461.845149:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788359461.845153:0:15805:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788359461.845158:0:15805:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa0e9c7129800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788359461.845163:0:15805:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffffa0e9c5618000) has exports, disconnecting them 00000020:00080000:2.0:1788359461.845166:0:15805:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa0e9c7129800), last request at 1788359249 00000020:00000080:2.0:1788359461.845170:0:15805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae36c 00000020:00080000:2.0:1788359461.845180:0:15805:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0e9c7129800): rc 0 00000020:00000080:2.0:1788359461.845184:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0e9c7129800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788359461.845889:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c7129800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788359461.848570:0:15805:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788359461.848576:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788359461.848580:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788359461.848585:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788359461.848652:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0e9c712d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788359461.848739:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788359461.848747:0:15805:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788359461.848752:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0e9c712a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788359461.848755:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c712a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788359461.848764:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788359461.848842:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788359461.848847:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788359461.848852:0:15805:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788359461.848858:0:15805:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffffa0eaffa8d800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788359461.848864:0:15805:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffffa0eafef799c0) has exports, disconnecting them 00000020:00080000:0.0:1788359461.848870:0:15805:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffffa0eaffa8d800), last request at 1788359249 00000020:00000080:0.0:1788359461.848874:0:15805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae381 00000020:00080000:0.0:1788359461.848909:0:15805:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0eaffa8d800): rc 0 00000020:00000080:0.0:1788359461.848915:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaffa8d800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788359461.848969:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa8d800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788359461.851582:0:15805:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788359461.851591:0:15805:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788359461.851594:0:15805:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788359461.851599:0:15805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788359461.851657:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0eaffa88000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788359461.851685:0:10394:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788359461.851726:0:6503:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788359461.851784:0:6504:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788359461.851904:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0eac3289c00:6498] 0 exiting: rc = 1 00000100:00100000:2.0:1788359461.851928:0:8447:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffffa0eafec15800:8447] 2 exiting: rc = 0 00000100:00100000:1.0:1788359461.851932:0:6499:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa0ead09f6000:6499] 1 exiting: rc = 0 00000100:00100000:0.0:1788359461.852019:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359461.852299:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa0eae56fd200:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1788359461.852309:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa0ead09f7400:6502] 2 exiting: rc = 0 00000100:00100000:0.0:1788359461.852312:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa0ead09f6c00:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788359461.852317:0:10335:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffffa0e9c7523600:10335] 4 exiting: rc = 0 00000100:00100000:3.0:1788359461.852449:0:7465:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0eaf6c9d800:7465] 3 exiting: rc = 0 00000100:00100000:1.0:1788359461.852619:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852626:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852633:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852639:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852645:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852651:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852657:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852662:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852668:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852673:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852690:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852701:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852707:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852712:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852719:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852725:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852732:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852737:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852743:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852748:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852755:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852768:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852778:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852783:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852788:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852793:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852798:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852812:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852825:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852832:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852839:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852843:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852848:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852853:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852858:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852864:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852869:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852874:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852879:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852885:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852890:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852895:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852899:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852905:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852910:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852915:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852920:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852925:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852930:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852935:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852941:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852947:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852951:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852956:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852961:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852966:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852971:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852976:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852980:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852986:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852991:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.852996:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.853009:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.853014:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788359461.853833:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359461.853842:0:15805:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788359461.853848:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaffa8d000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788359461.853852:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaffa8d000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788359461.853858:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788359461.853905:0:15805:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaff1c4000 1 00000020:00000080:1.0:1788359461.853910:0:15805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x49dd053b5feae311 00000020:00000080:1.0:1788359461.853916:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0e9c5606000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788359461.853930:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788359461.853933:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359461.853938:0:15805:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788359461.853941:0:15805:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffffa0eaffa44d40) has no exports 00000020:00000080:3.0:1788359461.853951:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa0e9c5606000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788359461.870303:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359461.870314:0:15805:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788359461.870318:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eaff1c4800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788359461.870321:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eaff1c4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788359461.870325:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788359461.870700:0:15805:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0eaff1c2000 00000020:01000000:1.0:1788359461.870728:0:15805:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788359461.870733:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788359461.870737:0:15805:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788359461.870741:0:15805:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffffa0eae4d83380) has no exports 00000020:00000080:1.0:1788359461.870770:0:15805:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788359461.870775:0:15805:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788359461.870778:0:15805:0:(genops.c:906:class_export_put()) final put ffffa0eafef9f000/OSS_uuid 00000020:00000080:1.0:1788359461.870780:0:15805:0:(genops.c:865:class_export_destroy()) destroying export ffffa0eafef9f000/OSS_uuid for OSS 00000020:01000000:1.0:1788359461.870784:0:15805:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788359461.870862:0:8882:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa0eafef13000:8882] 3 exiting: rc = 0 00000100:00100000:2.0:1788359461.870895:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0eb007bc600:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788359461.870981:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0eafef11400:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1788359461.871012:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0eafeef6800:8433] 2 exiting: rc = 0 00000100:00100000:1.0:1788359461.871121:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871132:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871139:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788359461.871143:0:6511:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788359461.871148:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871166:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871204:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871212:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871218:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871225:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871233:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871241:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871248:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871255:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871259:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871264:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871269:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871273:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871277:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871281:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871285:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871290:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871294:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871298:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871302:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871306:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871310:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871314:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871318:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871322:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871326:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871330:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871334:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871338:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871343:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871347:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871351:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871354:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871358:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871362:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871372:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871377:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871381:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871386:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871390:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871394:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871398:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871402:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871406:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871410:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871423:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871429:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871433:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871438:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871442:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871446:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871450:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871455:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871460:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871465:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871469:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871474:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871478:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871483:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.871489:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788359461.872533:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0ead276a400:8434] 0 exiting: rc = 1 00000100:00100000:0.0:1788359461.872560:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0ead276a600:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1788359461.872698:0:10901:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffffa0eac2d2ca00:10901] 2 exiting: rc = 0 00000100:00100000:1.0:1788359461.872745:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872752:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872759:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872762:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872765:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872769:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872772:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872775:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872779:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872782:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872793:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872796:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872800:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872805:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872811:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872815:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872821:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872827:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872832:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872838:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872933:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872941:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872947:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872952:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872957:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872963:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872968:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872973:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872979:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872984:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872990:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.872997:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873002:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873007:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873012:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873018:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873023:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873028:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873033:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873038:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873043:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873048:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873054:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873059:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873064:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873077:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873083:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873088:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873092:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873097:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873102:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873106:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873109:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873112:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873115:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873118:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873121:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873124:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873127:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873130:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873133:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873136:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873140:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.873150:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788359461.873983:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0eaf6c9c400:8438] 2 exiting: rc = 0 00000100:00100000:3.0:1788359461.874088:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0eaf6c9c600:8437] 1 exiting: rc = 0 00000100:00100000:0.0:1788359461.874168:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0eaf6c9ce00:8436] 0 exiting: rc = 1 00000100:00100000:1.0:1788359461.874197:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874210:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874217:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874223:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874227:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874230:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874234:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874237:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874240:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874244:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874247:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874251:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874255:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874258:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874262:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874265:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874275:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874278:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874292:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874295:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874299:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874302:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874306:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874309:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874313:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874316:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874320:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874324:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874327:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874331:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874335:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874339:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874342:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874347:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874351:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874355:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874358:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874362:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874366:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874369:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874372:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874376:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874389:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874393:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874396:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874399:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874403:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874406:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874410:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874413:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874437:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874447:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874460:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874464:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874467:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874471:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874474:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874478:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874481:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874484:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874488:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874577:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874587:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.874607:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.878637:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0eb00c23600:8440] 1 exiting: rc = 0 00000100:00100000:2.0:1788359461.879596:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0eb00c22e00:8439] 0 exiting: rc = 1 00000100:00100000:1.0:1788359461.879650:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879656:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879663:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879667:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879671:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879674:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879678:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879688:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879693:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879699:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879704:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879709:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879714:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879717:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879721:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879725:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879728:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879731:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879734:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879737:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879773:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879786:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879789:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879792:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879796:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879800:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879803:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879806:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879810:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879813:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879816:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879819:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879822:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879824:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879827:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879830:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879833:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879836:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879841:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879846:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879851:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879858:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879862:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879867:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879872:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879876:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879881:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879885:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879890:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879895:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879900:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879906:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879912:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879923:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879934:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879940:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879949:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879953:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879958:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879963:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879967:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879972:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879977:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.879985:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788359461.880463:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0eb00c23a00:8441] 0 exiting: rc = 1 00000100:00100000:0.0:1788359461.880672:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0eb00c23000:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1788359461.880717:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880728:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880734:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880739:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880744:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880750:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880755:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880759:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880765:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880770:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880774:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880779:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880795:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880800:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880805:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880810:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880816:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880820:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880825:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880830:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880835:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880840:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880845:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880850:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880866:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880871:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880875:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880885:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880890:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880895:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880900:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880905:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880911:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880915:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880920:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880925:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880939:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880944:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880948:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880953:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880958:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880962:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880966:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880971:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880976:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880980:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880985:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.880990:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881003:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881008:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881013:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881017:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881022:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881027:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881032:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881036:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881041:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881045:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881050:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881054:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881068:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881073:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881081:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788359461.881086:0:15805:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788359461.887806:0:15805:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788359472.795619:0:16569:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788359479.115541:0:17168:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788359479.115548:0:17168:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788359479.115550:0:17168:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788359479.115663:0:17168:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0ead20a0000 00000020:01000004:3.0:1788359479.115679:0:17168:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788359479.115687:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359479.115804:0:17168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0e9c56199c0) 00000020:00000080:3.0:1788359479.115822:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788359479.156596:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.157172:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788359479.158122:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.158269:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.158446:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.158829:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.159018:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.159193:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.159395:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.159669:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.159893:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.160115:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.160338:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.160632:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.160854:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.161018:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.161185:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.161370:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.161619:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.161794:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.161940:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.162070:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.162210:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.162399:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.162646:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.162854:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.163010:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.163195:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.163363:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.163576:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.163784:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.163976:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.164129:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788359479.164424:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788359479.164973:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.165290:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.165532:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.165778:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.165964:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.166138:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.166310:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.166478:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.166810:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.166971:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.167217:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788359479.167403:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.169246:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.170463:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.170971:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.171176:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.171562:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.171778:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788359479.171980:0:17168:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1788359479.172338:0:17168:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788359479.172705:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788359479.172712:0:17168:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788359479.172722:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf555 00000020:01000004:2.0:1788359479.172728:0:17168:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788359479.172732:0:17168:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788359479.172736:0:17168:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ead20a0000 from MGS 00000020:01000004:2.0:1788359479.172739:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788359479.172751:0:17168:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0eafef78000) 00000020:00000080:2.0:1788359479.172762:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788359479.172822:0:17168:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ead20a0000 from MGS, refs=2 00080000:01000000:2.0:1788359479.172827:0:17168:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788359479.172831:0:17168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf563 00000100:00100000:2.0:1788359479.172916:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788359479.173027:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788359479.173031:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788359479.174583:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788359479.174594:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788359479.175267:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359479.175473:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788359479.175479:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788359479.175991:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788359479.175998:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788359479.176244:0:17168:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788359479.176263:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788359479.176802:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.176806:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.176808:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.177060:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.177063:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.177065:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359479.177582:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788359479.178646:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788359479.182748:0:17168:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788359479.186505:0:17180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788359479.186905:0:17168:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788359479.186948:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788359479.190010:0:17168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788359479.190313:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359479.191563:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788359479.191570:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788359479.194032:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788359479.194102:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788359479.195584:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788359479.195594:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788359479.196925:0:17185:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788359479.197070:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788359479.197089:0:17168:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.152@tcp' 00000020:01000004:1.0:1788359479.197090:0:17168:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788359479.197112:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.152@tcp (typ=mgc) 00000020:00000080:1.0:1788359479.197123:0:17168:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.152@tcp (ffffa0e9c6870000) 00000020:00000080:1.0:1788359479.197136:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788359479.197195:0:17168:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c77bc800@MGC192.168.202.152@tcp: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359479.197337:0:17168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.152@tcp-0 is initialized 00000040:01000000:1.0:1788359479.197344:0:17168:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788359479.198632:0:17186:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788359479.198841:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.152@tcp (uuid caaeac2e-9afd-44da-91ff-e628fee28e20) 00000020:00000080:1.0:1788359479.198861:0:17168:0:(genops.c:1406:class_connect()) connect: client caaeac2e-9afd-44da-91ff-e628fee28e20, cookie 0x49dd053b5feaf571 00000100:00080000:1.0:1788359479.198871:0:17168:0:(import.c:510:import_select_connection()) MGC192.168.202.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359479.198877:0:17168:0:(import.c:624:import_select_connection()) MGC192.168.202.152@tcp: import ffffa0e9c77bc800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359479.198907:0:17168:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80ef480 x1875230445431936/t0(0) o250->MGC192.168.202.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359479.198933:0:17168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import caaeac2e-9afd-44da-91ff-e628fee28e20->MGS 00000020:01000004:1.0:1788359479.198957:0:17168:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788359479.198961:0:17168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788359479.198972:0:17168:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0e9c68719c0) 00000020:00000080:1.0:1788359479.198982:0:17168:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788359479.199041:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:caaeac2e-9afd-44da-91ff-e628fee28e20:3641:1875230445431936:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788359479.199117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.199193:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445431936 00000100:00100000:0.0:1788359479.199200:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445431936 00000100:00100000:0.0:1788359479.199231:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359479.199238:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3641:x1875230445431936:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788359479.199284:0:17182:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from caaeac2e-9afd-44da-91ff-e628fee28e20@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1788359479.199309:0:17182:0:(genops.c:1406:class_connect()) connect: client caaeac2e-9afd-44da-91ff-e628fee28e20, cookie 0x49dd053b5feaf57f 00000100:00080000:0.0:1788359479.199622:0:17182:0:(import.c:65:import_set_state_nolock()) ffffa0ead27cf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359479.199677:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+5:3641:x1875230445431936:12345-0@lo:250:mount.lustre.0 Request processed in 437us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.199685:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359479.199726:0:3641:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788359479.199734:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) MGC192.168.202.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1788359479.199740:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) MGC192.168.202.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788359479.199744:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788359479.199748:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c77bc800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788359479.199750:0:3641:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788359479.199764:0:3641:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788359479.199769:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:caaeac2e-9afd-44da-91ff-e628fee28e20:3641:1875230445431936:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788359479.214165:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788359479.214342:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788359479.214348:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788359479.222346:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788359479.222366:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788359479.222962:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788359479.222976:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788359479.223879:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359479.224032:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788359479.224037:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788359479.224990:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788359479.224998:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788359479.257028:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359479.257221:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788359479.257228:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788359479.258387:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788359479.258395:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788359479.259243:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788359479.259402:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788359479.259408:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788359479.260032:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788359479.260039:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788359479.260874:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359479.261005:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788359479.261009:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788359479.261435:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788359479.261442:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788359479.262284:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359479.262402:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788359479.262407:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788359479.262962:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788359479.262969:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788359479.280089:0:17168:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359479.280319:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788359479.280326:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788359479.282045:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788359479.282057:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788359479.282955:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788359479.282963:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788359479.283948:0:17168:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788359479.283977:0:17168:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788359479.283984:0:17168:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788359479.284090:0:17168:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788359479.284121:0:17168:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.152@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788359479.284126:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788359479.284127:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788359479.284129:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359479.284130:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359479.284131:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359479.284133:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359479.284134:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359479.284135:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788359479.284138:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359479.284139:0:17168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359479.284142:0:17168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788359479.284144:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359479.284145:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788359479.284146:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359479.284147:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359479.284148:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359479.284150:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359479.284151:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359479.284152:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788359479.284153:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359479.284154:0:17168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788359479.284180:0:17168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788359479.284199:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432064:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788359479.284279:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359479.284383:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.284455:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432064 00000100:00100000:3.0:1788359479.284462:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432064 00000100:00100000:3.0:1788359479.284729:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788359479.284739:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+5:17168:x1875230445432064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788359479.284785:0:17184:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788359479.284789:0:17184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788359479.284791:0:17184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788359479.285089:0:17205:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788359479.285466:0:17184:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788359479.290426:0:17206:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788359479.290433:0:17206:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788359479.290437:0:17206:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788359479.290440:0:17206:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788359479.290873:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788359479.291113:0:17184:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788359479.291124:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788359479.295340:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+5:17168:x1875230445432064:12345-0@lo:253:mount.lustre.0 Request processed in 10593us (11051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.295353:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359479.295542:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432064:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788359479.295570:0:17168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788359479.295574:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359479.295576:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788359479.295577:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359479.295578:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359479.295579:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359479.295581:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359479.295582:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359479.295583:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788359479.295586:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359479.295587:0:17168:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788359479.295608:0:17168:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0ead20a0000 from lustre-MDT0000 10000000:01000000:0.0:1788359479.295641:0:17168:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788359479.295645:0:17168:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788359479.295649:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0e9c6870000 10000000:01000000:0.0:1788359479.295653:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359479.295661:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0e9c6870000 from 1 10000000:01000000:0.0:1788359479.295663:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788359479.295701:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.295712:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.295722:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.295743:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359479.295789:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.295827:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac9302840 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.295991:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432192 00000100:00100000:3.0:1788359479.295999:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432192 00000100:00100000:3.0:1788359479.296042:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359479.296051:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+5:17168:x1875230445432192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359479.296064:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359479.296078:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6c00/0x49dd053b5feaf58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf586 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.296100:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6c00/0x49dd053b5feaf58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf586 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.296110:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6c00/0x49dd053b5feaf58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf586 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.296119:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6c00, rc 0) 00000100:00100000:3.0:1788359479.296153:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+6:17168:x1875230445432192:12345-0@lo:101:mount.lustre.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.296159:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359479.296246:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359479.296272:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.296281:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359479.296334:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359479.296366:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.296388:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.296444:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432320 00000100:00100000:3.0:1788359479.296448:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432320 00000100:00100000:3.0:1788359479.296470:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359479.296475:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+6:17168:x1875230445432320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359479.296582:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+6:17168:x1875230445432320:12345-0@lo:501:mount.lustre.0 Request processed in 106us (214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788359479.296589:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359479.296710:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788359479.296737:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788359479.296763:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.296772:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359479.296780:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0ead20a0000 10000000:01000000:1.0:1788359479.296784:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788359479.296788:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0ead20a0000 10000000:01000000:1.0:1788359479.296790:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788359479.296793:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0ead20a0000 from 1 10000000:01000000:1.0:1788359479.296795:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788359479.296811:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.296819:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.296834:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359479.296846:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359479.296885:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.296902:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.297079:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432448 00000100:00100000:0.0:1788359479.297084:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432448 00000100:00100000:0.0:1788359479.297108:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359479.297115:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+6:17168:x1875230445432448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359479.297123:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359479.297134:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac91c8200/0x49dd053b5feaf59b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf594 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.297147:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac91c8200/0x49dd053b5feaf59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf594 expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.297156:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac91c8200/0x49dd053b5feaf59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf594 expref: 7 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.297162:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8200, rc 0) 00000100:00100000:0.0:1788359479.297189:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+7:17168:x1875230445432448:12345-0@lo:101:mount.lustre.0 Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.297194:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359479.297269:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359479.297279:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf59b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.297287:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf59b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359479.297298:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788359479.297301:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf59b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.297308:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030400/0x49dd053b5feaf594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf59b expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359479.297314:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788359479.297317:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359479.297321:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0ead20a0000 10000000:01000000:1.0:1788359479.297324:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788359479.297326:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788359479.297328:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788359479.297341:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.297354:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.297361:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359479.297373:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359479.297398:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.297419:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.297487:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432576 00000100:00100000:3.0:1788359479.297492:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432576 00000100:00100000:3.0:1788359479.297530:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788359479.297536:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+7:17168:x1875230445432576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359479.297543:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359479.297655:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6400/0x49dd053b5feaf5a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf5a2 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.297670:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6400/0x49dd053b5feaf5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf5a2 expref: 8 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.297679:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6400/0x49dd053b5feaf5a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf5a2 expref: 8 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.297686:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6400, rc 0) 00000100:00100000:3.0:1788359479.297724:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+8:17168:x1875230445432576:12345-0@lo:101:mount.lustre.0 Request processed in 188us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.297730:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359479.297921:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359479.297932:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf5a9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.297939:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf5a9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359479.297982:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359479.298007:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.298022:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.298073:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432704 00000100:00100000:3.0:1788359479.298078:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432704 00000100:00100000:3.0:1788359479.298108:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359479.298116:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+8:17168:x1875230445432704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359479.298256:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17168:x1875230445432704:12345-0@lo:501:mount.lustre.0 Request processed in 133us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.298263:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359479.298360:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359479.298386:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359479.298422:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.298443:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.298633:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432832 00000100:00100000:0.0:1788359479.298638:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432832 00000100:00100000:0.0:1788359479.298666:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359479.298672:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17168:x1875230445432832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359479.299982:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17168:x1875230445432832:12345-0@lo:503:mount.lustre.0 Request processed in 1306us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.300012:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359479.300092:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445432832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359479.300713:0:17207:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17207:1875230445432960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359479.300821:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359479.300885:0:17207:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1ddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.300918:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445432960 00000100:00100000:0.0:1788359479.300924:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445432960 00000100:00100000:0.0:1788359479.301003:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359479.301011:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17207:x1875230445432960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359479.301658:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17207:x1875230445432960:12345-0@lo:502:llog_process_th.0 Request processed in 647us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.301671:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359479.301755:0:17207:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17207:1875230445432960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359479.301781:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359479.301793:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359479.301795:0:17207:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788359479.301800:0:17207:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788359479.301803:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359479.301818:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0eafef7b380) 00000020:00000080:2.0:1788359479.301835:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788359479.301840:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788359479.301917:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788359479.301922:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf5b7 00000020:00000080:2.0:1788359479.302122:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788359479.302127:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359479.302131:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359479.302132:0:17207:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788359479.302135:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359479.302138:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359479.302140:0:17207:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788359479.302143:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359479.302150:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0eafef799c0) 00000020:00000080:2.0:1788359479.302159:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788359479.302163:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788359479.302165:0:17207:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788359479.302168:0:17207:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788359479.302174:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788359479.302223:0:17207:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ead20a0000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788359479.302235:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0eafef7cd40) 00000020:00000080:2.0:1788359479.302259:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788359479.302309:0:17207:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788359479.302314:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf5cc 00000020:00000080:2.0:1788359479.302400:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788359479.302407:0:17207:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788359479.302411:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x49dd053b5feaf5d3 00080000:01000000:2.0:1788359479.302416:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788359479.302420:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf5da 00010000:00010000:3.0:1788359479.356894:0:17207:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788359479.357328:0:17207:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788359479.358153:0:17207:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788359479.358658:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0e9c561b380) 00000020:00000080:3.0:1788359479.358677:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788359479.358738:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788359479.358745:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf5e8 00000020:00000080:3.0:1788359479.360016:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788359479.365649:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x49dd053b5feaf5ef 00000020:00000080:0.0:1788359479.366333:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788359479.366346:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359479.366353:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.366355:0:17207:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788359479.366358:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788359479.366361:0:17207:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788359479.366363:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359479.366365:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359479.366366:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788359479.366369:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.366370:0:17207:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788359479.366372:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359479.366376:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.366378:0:17207:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788359479.366382:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788359479.366739:0:17207:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788359479.366831:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359479.366836:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.366837:0:17207:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788359479.366841:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359479.366845:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.366846:0:17207:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788359479.366849:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788359479.366855:0:17207:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:00000080:0.0:1788359479.366885:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788359479.366903:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffffa0eaffa40000) 00000020:00000080:0.0:1788359479.366922:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788359479.366927:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788359479.366992:0:17207:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788359479.366999:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788359479.367005:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf5fd 00010000:00080000:0.0:1788359479.367049:0:17207:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eae4c86800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:0.0:1788359479.369739:0:17207:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788359479.370838:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788359479.370853:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788359479.370889:0:17207:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788359479.370914:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf604 00000100:00080000:3.0:1788359479.370925:0:17207:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359479.370930:0:17207:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa0eae4c86800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359479.370966:0:17207:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9880 x1875230445433088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359479.371027:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359479.371144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788359479.371220:0:17207:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788359479.371342:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359479.371347:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.371349:0:17207:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788359479.371352:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788359479.371356:0:17207:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788359479.371357:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359479.371359:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359479.371360:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788359479.371371:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.371373:0:17207:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788359479.371376:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788359479.371380:0:17207:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788359479.371384:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.371385:0:17207:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788359479.371388:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788359479.371392:0:17207:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:3.0:1788359479.371412:0:17207:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788359479.371415:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359479.371426:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0e9c5618000) 00000020:00000080:3.0:1788359479.371438:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788359479.371443:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788359479.371628:0:17207:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788359479.371637:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788359479.371643:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf612 00010000:00080000:3.0:1788359479.371675:0:17207:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eb006a7000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.152@tcp at head 00000100:00100000:2.0:1788359479.371807:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433088 00000100:00100000:2.0:1788359479.371818:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433088 00000100:00100000:2.0:1788359479.371850:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359479.371857:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445433088:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788359479.371874:0:17194:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:3.0:1788359479.371895:0:17207:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788359479.373108:0:17207:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788359479.373340:0:17207:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788359479.375297:0:17207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359479.375719:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788359479.375885:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788359479.376348:0:17213:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788359479.376353:0:17213:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788359479.377860:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788359479.377875:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788359479.377916:0:17207:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788359479.377939:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf619 00000100:00080000:3.0:1788359479.377951:0:17207:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359479.377957:0:17207:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0eb006a7000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359479.378647:0:17207:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b8700 x1875230445433216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788359479.378682:0:17207:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788359479.378779:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359479.378784:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.378786:0:17207:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788359479.378790:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788359479.378793:0:17207:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788359479.378794:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359479.378796:0:17207:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359479.378798:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788359479.378800:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.378802:0:17207:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788359479.378805:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788359479.378809:0:17207:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788359479.378812:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.378813:0:17207:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788359479.378817:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788359479.378821:0:17207:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:3.0:1788359479.378847:0:17207:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788359479.378850:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359479.378862:0:17207:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0e9c561cd40) 00000020:00000080:3.0:1788359479.378879:0:17207:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788359479.378884:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788359479.378948:0:17207:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788359479.378954:0:17207:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788359479.378960:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x49dd053b5feaf627 00010000:00080000:3.0:1788359479.379004:0:17207:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eb0068a800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359479.379214:0:17207:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788359479.379293:0:17207:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788359479.379309:0:17207:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788359479.379529:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433216:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788359479.379658:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445433216 offset 0 length 520: 4 00000040:00080000:3.0:1788359479.385870:0:17207:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359479.386724:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788359479.386974:0:17207:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788359479.387415:0:17215:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788359479.387421:0:17215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788359479.388392:0:17207:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788359479.388406:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788359479.388443:0:17207:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788359479.388465:0:17207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf62e 00000100:00080000:3.0:1788359479.388745:0:17207:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359479.388777:0:17207:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0eb0068a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359479.388813:0:17207:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27bbb80 x1875230445433344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359479.388877:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433344:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788359479.388950:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445433344 offset 0 length 520: 4 00000100:00080000:3.0:1788359479.389015:0:17207:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788359479.389109:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359479.389115:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.389117:0:17207:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788359479.389120:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359479.389124:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.389125:0:17207:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788359479.389128:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788359479.389130:0:17207:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788359479.389132:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359479.389134:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.389136:0:17207:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788359479.389138:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359479.389141:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359479.389142:0:17207:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788359479.389146:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788359479.389175:0:17207:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17207:1875230445433472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.389222:0:17207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359479.389240:0:17207:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac85710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359479.389336:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433472 00000100:00100000:1.0:1788359479.389343:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433472 00000100:00100000:1.0:1788359479.389417:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359479.389427:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17207:x1875230445433472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359479.389609:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17207:x1875230445433472:12345-0@lo:502:llog_process_th.0 Request processed in 184us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.389617:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359479.389707:0:17207:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17207:1875230445433472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788359479.389731:0:17207:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359479.389736:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.389738:0:17207:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788359479.389742:0:17207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788359479.389794:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788359479.389816:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788359479.389832:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf5a9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.389843:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031600/0x49dd053b5feaf5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf5a9 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359479.389851:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0ead20a0000 from 1 10000000:01000000:0.0:1788359479.389854:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788359479.389880:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.389888:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.389903:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.389917:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359479.389948:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.390274:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.390310:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433600 00000100:00100000:3.0:1788359479.390315:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433600 00000100:00100000:3.0:1788359479.390338:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788359479.390352:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+9:17168:x1875230445433600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359479.390362:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359479.390375:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf635 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.390396:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 10 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.390407:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 10 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.390416:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7600, rc 0) 00000100:00100000:3.0:1788359479.390448:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+10:17168:x1875230445433600:12345-0@lo:101:mount.lustre.0 Request processed in 98us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.390455:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359479.390799:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359479.390814:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.390823:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.391335:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433728:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788359479.391376:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.391441:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93020c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.396439:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433728 00000100:00100000:3.0:1788359479.396735:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433728 00000100:00100000:3.0:1788359479.396841:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359479.396852:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+10:17168:x1875230445433728:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788359479.396880:0:17183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788359479.396887:0:17183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788359479.397013:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+10:17168:x1875230445433728:12345-0@lo:256:mount.lustre.0 Request processed in 163us (5636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.397021:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359479.397097:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433728:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788359479.397724:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788359479.397745:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.397757:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359479.397765:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0ead20a0000 from 1 10000000:01000000:0.0:1788359479.397768:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359479.397846:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.397855:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.397865:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.397885:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359479.397924:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.398304:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359479.398343:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433856 00000100:00100000:1.0:1788359479.398349:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433856 00000100:00100000:1.0:1788359479.398381:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359479.398389:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+10:17168:x1875230445433856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359479.398400:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359479.398414:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf643 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.398436:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 11 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.398446:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 11 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.398649:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0030200, rc 0) 00000100:00100000:1.0:1788359479.398695:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445433856:12345-0@lo:101:mount.lustre.0 Request processed in 306us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.398701:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788359479.398833:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359479.398848:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.398858:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.398916:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359479.398943:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.398999:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359479.399031:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445433984 00000100:00100000:1.0:1788359479.399035:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445433984 00000100:00100000:1.0:1788359479.399090:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788359479.399098:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445433984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359479.399710:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445433984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359479.399710:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445433984:12345-0@lo:501:mount.lustre.0 Request processed in 611us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.399717:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359479.399744:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788359479.399816:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445433088:12345-0@lo:38:llog_process_th.0 Request processed in 27958us (28671us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788359479.399829:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788359479.399898:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359479.399903:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788359479.399907:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788359479.400120:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359479.400152:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.400206:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434112 00000100:00100000:0.0:1788359479.400211:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434112 00000100:00100000:0.0:1788359479.400244:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359479.400270:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445434112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359479.400371:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445434112:12345-0@lo:503:mount.lustre.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.400378:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788359479.401690:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359479.403569:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17217:1875230445434240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359479.403725:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.403766:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1dde40 going to sleep for 11 seconds 00000100:00100000:1.0:1788359479.403771:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434240 00000100:00100000:1.0:1788359479.403881:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434240 00000100:00100000:1.0:1788359479.404053:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788359479.404064:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17217:x1875230445434240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359479.405117:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17217:x1875230445434240:12345-0@lo:502:llog_process_th.0 Request processed in 1052us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.405127:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359479.405299:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17217:1875230445434240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788359479.405331:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359479.405457:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.405460:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788359479.405469:0:17217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ead20a0000 00000020:00000080:0.0:1788359479.405472:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788359479.405481:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359479.405484:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.405486:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788359479.405488:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359479.405490:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359479.405491:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788359479.405667:0:17217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0ead20a0000 00000020:00000080:1.0:1788359479.405670:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359479.405729:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359479.405734:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359479.405736:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788359479.405739:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359479.405741:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359479.405743:0:17217:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788359479.405746:0:17217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ead20a0000 00000020:00000080:1.0:1788359479.405748:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359479.405766:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359479.405769:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359479.405876:0:17217:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788359479.405880:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359479.406008:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359479.406010:0:17217:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788359479.406015:0:17217:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0ead20a0000 00000020:00000080:1.0:1788359479.406018:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788359479.406082:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17217:1875230445434368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788359479.406135:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.406228:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac476d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.406619:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434368 00000100:00100000:0.0:1788359479.406626:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434368 00000100:00100000:0.0:1788359479.406708:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788359479.406717:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17217:x1875230445434368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359479.406850:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17217:x1875230445434368:12345-0@lo:502:llog_process_th.0 Request processed in 134us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.406858:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359479.406941:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17217:1875230445434368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788359479.406964:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359479.406969:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359479.406971:0:17217:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788359479.406976:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788359479.407236:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788359479.407270:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788359479.407293:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.407310:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359479.407478:0:17168:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788359479.407482:0:17168:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0ead20a0000 10000000:01000000:0.0:1788359479.407485:0:17168:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0ead20a0000 10000000:01000000:0.0:1788359479.407489:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359479.408439:0:17168:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0ead20a0000 from 1 10000000:01000000:0.0:1788359479.408445:0:17168:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788359479.408482:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.408506:0:17168:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.408517:0:17168:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.408543:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359479.408609:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.408652:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359479.408748:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434496 00000100:00100000:1.0:1788359479.408756:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434496 00000100:00100000:1.0:1788359479.408913:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788359479.409032:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17168:x1875230445434496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359479.409110:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359479.409125:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feaf658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf651 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.409149:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feaf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf651 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.409160:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031a00/0x49dd053b5feaf658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf651 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.409169:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031a00, rc 0) 00000100:00100000:1.0:1788359479.409208:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445434496:12345-0@lo:101:mount.lustre.0 Request processed in 180us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.409215:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788359479.410373:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359479.410396:0:17168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf658 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.410406:0:17168:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf658 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.410514:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359479.410558:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359479.410590:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac93026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.410608:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434624 00000100:00100000:0.0:1788359479.410613:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434624 00000100:00100000:0.0:1788359479.410655:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359479.410663:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445434624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359479.411665:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359479.411702:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359479.419226:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359479.419286:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.420116:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445434624:12345-0@lo:501:mount.lustre.0 Request processed in 9450us (9554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.420129:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359479.420182:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434752 00000100:00100000:0.0:1788359479.420190:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434752 00000100:00100000:0.0:1788359479.420239:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788359479.420259:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445434752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359479.420896:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445434752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359479.421130:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445434752:12345-0@lo:503:mount.lustre.0 Request processed in 635us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.421140:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788359479.429192:0:17222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445434880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.429289:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359479.429326:0:17222:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8571f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359479.429446:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445434880 00000100:00100000:2.0:1788359479.429692:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445434880 00000100:00100000:2.0:1788359479.429816:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788359479.429827:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445434880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788359479.429943:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445434880:12345-0@lo:502:llog_process_th.0 Request processed in 118us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359479.429951:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788359479.430309:0:17222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445434880:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788359479.430372:0:17222:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788359479.430395:0:17222:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0eac6858000) 00000020:00000080:3.0:1788359479.430415:0:17222:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788359479.435374:0:17222:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0ead20a0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788359479.435384:0:17222:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0ead20a0000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788359479.435388:0:17222:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0ead20a0000 4 00010000:00080000:3.0:1788359479.435426:0:17222:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaffa8f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359479.442305:0:17222:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788359479.442686:0:17222:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788359479.442735:0:17222:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788359479.442810:0:17222:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x49dd053b5feaf666 00000100:00080000:3.0:1788359479.442823:0:17222:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359479.442829:0:17222:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0eaffa8f800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359479.442865:0:17222:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9f80 x1875230445435008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359479.443038:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445435008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359479.443115:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788359479.443185:0:17222:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788359479.443399:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435008 00000100:00100000:2.0:1788359479.443406:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435008 00000100:00100000:2.0:1788359479.443438:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359479.443445:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445435008:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788359479.443654:0:17222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445435136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.443696:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359479.443720:0:17222:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359479.444094:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445435008:12345-0@lo:38:llog_process_th.0 Request processed in 647us (978us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788359479.444103:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359479.444158:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359479.444167:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359479.444172:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788359479.444175:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445435008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359479.444204:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435136 00000100:00100000:0.0:1788359479.444214:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435136 00000100:00100000:0.0:1788359479.444405:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359479.444412:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445435136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788359479.444874:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445435136:12345-0@lo:502:llog_process_th.0 Request processed in 461us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.444880:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359479.445160:0:17222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445435136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.445204:0:17222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445435264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.445232:0:17222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359479.445276:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435264 00000100:00100000:3.0:1788359479.445281:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435264 00000100:00100000:3.0:1788359479.445309:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359479.445316:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445435264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788359479.445478:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17222:x1875230445435264:12345-0@lo:502:llog_process_th.0 Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.445486:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359479.445542:0:17222:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.445675:0:17222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:caaeac2e-9afd-44da-91ff-e628fee28e20:17222:1875230445435264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788359479.445695:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788359479.445823:0:17168:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788359479.445846:0:17168:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788359479.445862:0:17168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf658 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359479.445873:0:17168:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8c00/0x49dd053b5feaf651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf658 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788359479.445920:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788359479.445923:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788359479.445924:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359479.445925:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359479.445927:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359479.445928:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359479.445930:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788359479.445931:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788359479.445933:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359479.445934:0:17168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788359479.445938:0:17168:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788359479.445940:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788359479.445941:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788359479.445947:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359479.445948:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359479.445949:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359479.445950:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359479.445951:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788359479.445951:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788359479.445953:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359479.445953:0:17168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788359479.445967:0:17168:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788359479.445977:0:17168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445435392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788359479.446007:0:17168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359479.446037:0:17168:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359479.446149:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435392 00000100:00100000:0.0:1788359479.446153:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435392 00000100:00100000:0.0:1788359479.446217:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788359479.446226:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445435392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788359479.446258:0:17183:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788359479.446273:0:17183:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788359479.448228:0:17183:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788359479.448244:0:17183:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788359479.448444:0:17205:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788359479.448449:0:17205:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788359479.448479:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.448511:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.448520:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.448683:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.448699:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359479.448713:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445435520:0@lo:104: 00000100:00100000:2.0:1788359479.448830:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359479.448875:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff1ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359479.448937:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435520 00000100:00100000:3.0:1788359479.448944:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435520 00000100:00100000:3.0:1788359479.448983:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359479.448991:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445435520:12345-0@lo:104: 00010000:00010000:3.0:1788359479.449004:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359479.449165:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17168:x1875230445435392:12345-0@lo:253:mount.lustre.0 Request processed in 2939us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359479.449173:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788359479.449255:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359479.449261:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445435520:12345-0@lo:104: Request processed in 271us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359479.449267:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788359479.449300:0:17168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17168:1875230445435392:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788359479.449310:0:17168:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788359479.449313:0:17168:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788359479.449314:0:17168:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788359479.449316:0:17168:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359479.449317:0:17168:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359479.449318:0:17168:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359479.449319:0:17168:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359479.449320:0:17168:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788359479.449322:0:17168:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788359479.449328:0:17168:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359479.449329:0:17168:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788359479.449342:0:17168:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788359479.451486:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359479.451516:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.451527:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359479.451531:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.451540:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359479.451557:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359479.451572:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359479.451615:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.451622:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359479.451642:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.451649:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf63c expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359479.451664:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.451666:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359479.451667:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359479.451711:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445435648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788359479.451781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359479.451860:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435648 00000100:00100000:1.0:1788359479.451868:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435648 00010000:00010000:1.0:1788359479.452018:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359479.452122:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359479.452132:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:3645:x1875230445435648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359479.452147:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359479.452152:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452163:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 12 pid: 17183 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452180:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452187:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788359479.452201:0:17174:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003752711s 00010000:00010000:1.0:1788359479.452205:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452211:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452217:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452222:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452228:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebe00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359479.452239:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452258:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452268:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359479.452278:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359479.452313:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:3645:x1875230445435648:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359479.452321:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359479.452656:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445435648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359479.453329:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf63c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf635 expref: 11 pid: 17183 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359479.453344:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445435520:0@lo:104: 00010000:00010000:2.0:1788359479.453360:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.453369:0:17205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.453375:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359479.453380:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75ebe00/0x49dd053b5feaf66d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788359479.467269:0:17168:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788359479.467825:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788359479.467994:0:17229:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788359479.467998:0:17229:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788359479.468259:0:17230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788359479.468485:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1788359479.469102:0:17230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788359479.469722:0:17231:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffffa0ead28dd500 x1875230445435776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359479.469737:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000040:01000000:0.0:1788359479.471209:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788359479.471267:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788359479.472008:0:17168:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788359479.472018:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788359479.472057:0:17168:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359479.475379:0:17230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788359479.475459:0:17230:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788359479.476444:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788359479.477202:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788359479.477235:0:17168:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788359479.477901:0:17168:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1788359479.478526:0:17168:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788359479.480123:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788359479.481795:0:17168:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788359479.481831:0:17168:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb78b41c57988 00100000:10000000:0.0:1788359479.481838:0:17168:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788359479.482111:0:17168:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788359479.482125:0:17168:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788359479.482145:0:17168:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788359479.482159:0:17168:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788359479.486433:0:17168:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359479.490609:0:17168:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788359480.188677:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359480.508696:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000040:00080000:2.0:1788359480.510716:0:17225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788359480.510724:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359480.513550:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788359480.513564:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1788359480.572598:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788359480.572605:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0ead20a0000 from 7 10000000:01000000:1.0:1788359480.572610:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788359480.572646:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359480.572654:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359480.572662:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359480.572680:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445435904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788359480.572733:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359480.572796:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed71300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359480.574943:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435904 00000100:00100000:3.0:1788359480.574955:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435904 00000100:00100000:3.0:1788359480.575118:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788359480.575128:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+11:17186:x1875230445435904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359480.575146:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359480.576201:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf674 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359480.576245:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359480.576257:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 12 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359480.576266:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7c00, rc 0) 00000100:00100000:3.0:1788359480.576351:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17186:x1875230445435904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1225us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359480.576359:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359480.576557:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445435904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359480.576575:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359480.576585:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359480.576650:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445436032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788359480.576688:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359480.576714:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead15d1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788359480.576770:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436032 00000100:00100000:0.0:1788359480.576777:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436032 00000100:00100000:0.0:1788359480.576819:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788359480.576828:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17186:x1875230445436032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788359480.576844:0:17183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788359480.576859:0:17183:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788359480.576874:0:17183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788359480.576976:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17186:x1875230445436032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359480.576985:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788359480.576995:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445436032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788359480.577351:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359480.577359:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359480.577378:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359481.213528:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788359481.532875:0:17225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000100:00100000:3.0:1788359481.532930:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000040:00080000:0.0:1788359481.532981:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359481.533159:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788359481.533192:0:17225:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788359481.533355:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000001:02000400:3.0:1788359481.978204:0:17474:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788359482.236667:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359482.556653:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000020:00000004:3.0:1788359482.599687:0:17526:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359482.599871:0:17526:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1788359483.187196:0:17576:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359483.189885:0:17576:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359483.263528:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359483.580774:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00010000:00010000:3.0:1788359484.284728:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359484.605291:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000100:00080000:2.0:1788359484.605423:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788359484.605427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788359484.605430:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359484.605437:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1788359484.605442:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359484.605449:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa0eae4c86800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359484.605468:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28dc700 x1875230445436288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359484.605484:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359484.605487:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359484.605520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359484.605523:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359484.605525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788359484.605528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788359484.605530:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa8f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359484.605535:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0eaffa8f800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359484.605548:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28ddc00 x1875230445436416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359484.605608:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445436160:0@lo:400:kworker.0 00000100:00100000:2.0:1788359484.606802:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359484.606928:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445436288:0@lo:38:kworker.0 00000100:00100000:2.0:1788359484.606972:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359484.607002:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445436416:0@lo:38:kworker.0 00000100:00100000:0.0:1788359484.607012:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436288 00000100:00100000:0.0:1788359484.607020:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436288 00000100:00100000:2.0:1788359484.607027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359484.607048:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788359484.607055:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875230445436288:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788359484.607078:0:17195:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788359484.607125:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436160 00000100:00100000:3.0:1788359484.607130:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436160 00000100:00100000:3.0:1788359484.607169:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359484.607176:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:3642:x1875230445436160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359484.607235:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+12:3642:x1875230445436160:12345-0@lo:400:kworker.0 Request processed in 59us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359484.607243:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788359484.607291:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788359484.607993:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436416 00000100:00100000:1.0:1788359484.607999:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436416 00000100:00100000:1.0:1788359484.608024:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359484.608029:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3641:x1875230445436416:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788359484.608046:0:17191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1788359484.608082:0:17191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x49dd053b5feaf682 00000004:00100000:1.0:1788359484.608097:0:17191:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788359484.608228:0:17191:0:(import.c:65:import_set_state_nolock()) ffffa0e9c74cc000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359484.608280:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875230445436416:12345-0@lo:38:kworker.0 Request processed in 249us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359484.608287:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788359484.608321:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ead28ddc00 x1875230445436416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359484.608334:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788359484.608341:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788359484.608345:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788359484.608348:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaffa8f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359484.608353:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875230445436416:0@lo:38:kworker.0 00000100:00100000:0.0:1788359484.618238:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1875230445436288:12345-0@lo:38:kworker.0 Request processed in 11173us (11257us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788359484.618252:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788359484.618334:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359484.618339:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359484.618343:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445436288:0@lo:38:kworker.0 00010000:00010000:0.0:1788359485.308989:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359485.631032:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00010000:00010000:0.0:1788359486.332650:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359486.652621:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00010000:00010000:0.0:1788359487.358580:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788359487.470990:0:17920:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788359487.470996:0:17920:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788359487.470998:0:17920:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788359487.471114:0:17920:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0eaffa8a000 00000020:01000004:3.0:1788359487.471130:0:17920:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788359487.471148:0:17920:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359487.471161:0:17920:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffffa0eac68599c0) 00000020:00000080:3.0:1788359487.471188:0:17920:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788359487.522750:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788359487.524939:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.527805:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788359487.529588:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788359487.530133:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788359487.530832:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788359487.531080:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788359487.531536:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788359487.535052:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788359487.536584:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788359487.537679:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788359487.537913:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788359487.538162:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788359487.538378:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788359487.540776:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.541115:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.541345:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.541558:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.541930:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.542184:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.542686:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.542959:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.543203:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.543410:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.543732:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.544021:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788359487.544264:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788359487.544523:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.544978:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.545242:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.545430:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.545652:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.545920:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.546167:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.546377:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.546644:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.546959:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.547196:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.547391:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.547622:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.547805:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788359487.548126:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788359487.548401:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788359487.548889:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788359487.549120:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788359487.549333:0:17920:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00080000:01000000:1.0:1788359487.550073:0:17920:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788359487.550313:0:17920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788359487.550326:0:17920:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788359487.550337:0:17920:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf690 00000020:01000004:1.0:1788359487.550344:0:17920:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788359487.550365:0:17920:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788359487.550368:0:17920:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788359487.550373:0:17920:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788359487.550410:0:17920:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788359487.550415:0:17920:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788359487.555762:0:17920:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788359487.555807:0:17920:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.152@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788359487.555812:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788359487.555814:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788359487.555815:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359487.555817:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359487.555818:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359487.555819:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359487.555821:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359487.555822:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359487.555824:0:17920:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359487.555827:0:17920:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788359487.555830:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788359487.555831:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788359487.555833:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359487.555834:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359487.555835:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359487.555836:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359487.555837:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359487.555838:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359487.555839:0:17920:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359487.555863:0:17920:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788359487.555883:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788359487.555958:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.556073:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475540 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.556118:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436544 00000100:00100000:2.0:1788359487.556126:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436544 00000100:00100000:2.0:1788359487.556306:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359487.556316:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17920:x1875230445436544:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788359487.556355:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788359487.556358:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788359487.556366:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788359487.556796:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17920:x1875230445436544:12345-0@lo:253:mount.lustre.0 Request processed in 480us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.556804:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359487.556959:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788359487.556974:0:17920:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788359487.556977:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788359487.556978:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788359487.556979:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359487.556980:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359487.556981:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359487.556982:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359487.556983:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788359487.556984:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359487.556986:0:17920:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788359487.557002:0:17920:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0eaffa8a000 from lustre-MDT0001 10000000:01000000:1.0:1788359487.557023:0:17920:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788359487.557026:0:17920:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788359487.557032:0:17920:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0e9c6870000 local copy 00010000:00010000:1.0:1788359487.557041:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.557109:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359487.557136:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.557227:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.557262:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436672 00000100:00100000:2.0:1788359487.557266:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436672 00000100:00100000:2.0:1788359487.557294:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788359487.557300:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17920:x1875230445436672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359487.557360:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17920:x1875230445436672:12345-0@lo:501:mount.lustre.0 Request processed in 60us (224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788359487.557366:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359487.557444:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788359487.557455:0:17920:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788359487.557470:0:17920:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788359487.557476:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557484:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.557525:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eaffa8a000 10000000:01000000:1.0:1788359487.557534:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788359487.557539:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0e9c6870000 10000000:01000000:1.0:1788359487.557541:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788359487.557544:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa0e9c6870000 from 1 10000000:01000000:1.0:1788359487.557547:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788359487.557566:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557574:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557582:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.557593:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359487.557615:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.557642:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.557655:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436800 00000100:00100000:2.0:1788359487.557659:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436800 00000100:00100000:2.0:1788359487.557676:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788359487.557682:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+12:17920:x1875230445436800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359487.557690:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359487.557701:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eaa00/0x49dd053b5feaf69e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf697 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.557719:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eaa00/0x49dd053b5feaf69e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf697 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.557728:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eaa00/0x49dd053b5feaf69e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf697 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.557735:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eaa00, rc 0) 00000100:00100000:2.0:1788359487.557768:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+13:17920:x1875230445436800:12345-0@lo:101:mount.lustre.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.557774:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788359487.557860:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359487.557874:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf69e expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557884:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf69e expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.557899:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788359487.557911:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf69e expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557919:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030600/0x49dd053b5feaf697 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf69e expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.557939:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0eaffa8a000 10000000:01000000:1.0:1788359487.557943:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788359487.557946:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0eaffa8a000 from 1 10000000:01000000:1.0:1788359487.557948:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788359487.557962:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557969:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.557976:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.557994:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359487.558020:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.558041:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.558091:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445436928 00000100:00100000:3.0:1788359487.558096:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445436928 00000100:00100000:3.0:1788359487.558116:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359487.558122:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+13:17920:x1875230445436928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.558129:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359487.558137:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feaf6ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf6a5 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558152:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feaf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf6a5 expref: 14 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558160:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6600/0x49dd053b5feaf6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf6a5 expref: 14 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558166:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6600, rc 0) 00000100:00100000:3.0:1788359487.558217:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+14:17920:x1875230445436928:12345-0@lo:101:mount.lustre.0 Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.558224:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788359487.558242:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445436928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359487.558254:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ac expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.558262:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf6ac expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.558274:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788359487.558291:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ac expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.558298:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030000/0x49dd053b5feaf6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ac expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.558310:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788359487.558313:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359487.558317:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0eaffa8a000 10000000:01000000:1.0:1788359487.558320:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788359487.558323:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788359487.558325:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788359487.558339:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.558345:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.558353:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.558364:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359487.558388:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.558405:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.558434:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437056 00000100:00100000:3.0:1788359487.558438:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437056 00000100:00100000:3.0:1788359487.558467:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788359487.558473:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+14:17920:x1875230445437056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.558479:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359487.558486:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7200/0x49dd053b5feaf6ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf6b3 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558538:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7200/0x49dd053b5feaf6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf6b3 expref: 15 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558545:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7200/0x49dd053b5feaf6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf6b3 expref: 15 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.558552:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7200, rc 0) 00000100:00100000:3.0:1788359487.558587:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437056:12345-0@lo:101:mount.lustre.0 Request processed in 113us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.558594:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788359487.558601:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359487.558617:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ba expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.558625:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf6ba expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359487.560429:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788359487.564761:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359487.568220:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788359487.568275:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788359487.568293:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788359487.568306:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788359487.568320:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788359487.568336:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788359487.568351:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788359487.568366:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788359487.568385:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788359487.568401:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788359487.568416:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788359487.568430:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788359487.568443:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788359487.568456:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788359487.568470:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788359487.568485:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788359487.568553:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788359487.568571:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788359487.568585:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788359487.568598:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788359487.568625:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788359487.568641:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788359487.568655:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788359487.568683:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788359487.568689:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788359487.568805:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359487.568871:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359487.568921:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437184 00000100:00100000:3.0:1788359487.568923:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaccca6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.568930:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437184 00000100:00100000:2.0:1788359487.568988:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359487.568998:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359487.569162:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437184:12345-0@lo:501:mount.lustre.0 Request processed in 165us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.569183:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788359487.569248:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359487.569286:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359487.569332:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.569356:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475180 going to sleep for 11 seconds 00000100:00100000:0.0:1788359487.569386:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437312 00000100:00100000:0.0:1788359487.569391:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437312 00000100:00100000:0.0:1788359487.569427:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788359487.569434:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359487.569998:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437312:12345-0@lo:503:mount.lustre.0 Request processed in 564us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.570004:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788359487.570042:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788359487.570632:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359487.570716:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359487.570755:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.570793:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.570808:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437440 00000100:00100000:2.0:1788359487.570815:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437440 00000100:00100000:2.0:1788359487.570855:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359487.570862:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359487.571371:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437440:12345-0@lo:502:mount.lustre.0 Request processed in 507us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.571379:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788359487.571401:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437440:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359487.571612:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788359487.571637:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1788359487.571648:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1788359487.571658:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1788359487.571668:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1788359487.571678:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1788359487.571689:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1788359487.571699:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1788359487.571710:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1788359487.571722:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1788359487.571733:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1788359487.571746:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1788359487.571758:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1788359487.571771:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1788359487.571783:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1788359487.571796:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1788359487.571811:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1788359487.571824:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1788359487.571835:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1788359487.571849:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1788359487.571857:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1788359487.571872:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1788359487.571879:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1788359487.571886:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1788359487.571893:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1788359487.571900:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1788359487.571907:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1788359487.571914:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1788359487.571921:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1788359487.571928:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1788359487.571935:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1788359487.571942:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1788359487.571948:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1788359487.571956:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1788359487.571962:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1788359487.571969:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1788359487.571975:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1788359487.571981:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1788359487.571988:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1788359487.571994:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1788359487.572001:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1788359487.572008:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1788359487.572014:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1788359487.572020:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1788359487.572037:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359487.572064:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.572085:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac8475780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359487.572115:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437568 00000100:00100000:0.0:1788359487.572121:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437568 00000100:00100000:0.0:1788359487.572156:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359487.572162:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788359487.572259:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445437568:12345-0@lo:502:mount.lustre.0 Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.572266:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788359487.572293:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445437568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359487.572333:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788359487.572341:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788359487.572835:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.572843:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.572849:0:17924:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788359487.572853:0:17924:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788359487.572855:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788359487.572865:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffffa0e9c6873380) 00000020:00000080:1.0:1788359487.572879:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788359487.572882:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788359487.572934:0:17924:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788359487.572941:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf6c8 00000020:00000080:1.0:1788359487.573074:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788359487.573077:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359487.573079:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.573080:0:17924:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788359487.573081:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.573083:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.573084:0:17924:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788359487.573086:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788359487.573091:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffffa0e9c6874d40) 00000020:00000080:1.0:1788359487.573098:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788359487.573100:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788359487.573101:0:17924:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788359487.573103:0:17924:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788359487.573107:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788359487.573146:0:17924:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaffa8a000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788359487.573157:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffffa0eaf58d4d40) 00000020:00000080:1.0:1788359487.573165:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788359487.573246:0:17924:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788359487.573252:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf6dd 00000020:00000080:1.0:1788359487.573332:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788359487.573337:0:17924:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788359487.573340:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x49dd053b5feaf6e4 00080000:01000000:1.0:1788359487.573344:0:17924:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788359487.573346:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf6eb 00010000:00010000:1.0:1788359487.615349:0:17924:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788359487.615865:0:17924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788359487.618153:0:17924:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788359487.620457:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788359487.620470:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359487.620479:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.620482:0:17924:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788359487.620486:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359487.620491:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.620523:0:17924:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788359487.620529:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788359487.620534:0:17924:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:00000080:3.0:1788359487.620562:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359487.620578:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffffa0eac685b380) 00000020:00000080:3.0:1788359487.620600:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788359487.620606:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788359487.620688:0:17924:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788359487.620695:0:17924:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788359487.620702:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf6f9 00010000:00080000:3.0:1788359487.620735:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c6315000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359487.622307:0:17924:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788359487.631645:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788359487.631660:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788359487.631698:0:17924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788359487.631721:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf700 00000100:00080000:0.0:1788359487.631732:0:17924:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788359487.631737:0:17924:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffffa0e9c6315000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359487.631773:0:17924:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8124000 x1875230445437696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359487.631810:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445437696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359487.631878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359487.631936:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788359487.631942:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437696 00000100:00100000:3.0:1788359487.631950:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437696 00000100:00080000:0.0:1788359487.631956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788359487.631959:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788359487.631961:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359487.631964:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1788359487.631967:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788359487.631971:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa0eae4c86800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359487.631982:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8124380 x1875230445437824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788359487.631993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359487.631995:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788359487.631997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359487.631998:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788359487.632020:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359487.632028:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445437696:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359487.632042:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445437952:0@lo:400:kworker.0 00010000:00080000:3.0:1788359487.632052:0:17194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000100:00100000:0.0:1788359487.632076:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788359487.632109:0:17194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf707 00000100:00100000:0.0:1788359487.632116:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437952 00000100:00100000:0.0:1788359487.632119:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437952 00000004:00100000:3.0:1788359487.632125:0:17194:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788359487.632132:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788359487.632147:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788359487.632154:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445437952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359487.632218:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445437952:12345-0@lo:400:kworker.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.632225:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788359487.632261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0e9c8127480 x1875230445437952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359487.632277:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445437952:0@lo:400:kworker.0 00000100:00100000:0.0:1788359487.632295:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445437824:0@lo:38:kworker.0 00000100:00100000:0.0:1788359487.632311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359487.632327:0:17195:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788359487.632332:0:17195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:01000000:0.0:1788359487.632433:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359487.632437:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632439:0:17924:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788359487.632442:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788359487.632445:0:17924:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788359487.632446:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359487.632447:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359487.632449:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788359487.632451:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632453:0:17924:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788359487.632455:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359487.632460:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632462:0:17924:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788359487.632467:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788359487.632487:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445437824 00000100:00100000:0.0:1788359487.632491:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445437824 00000004:01000000:0.0:1788359487.632547:0:17924:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788359487.632561:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359487.632564:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632566:0:17924:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788359487.632569:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788359487.632570:0:17924:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788359487.632572:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359487.632573:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788359487.632574:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788359487.632576:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632582:0:17924:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788359487.632585:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788359487.632587:0:17924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788359487.632590:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359487.632592:0:17924:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788359487.632595:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788359487.632598:0:17924:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000100:00100000:3.0:1788359487.632602:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359487.632610:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875230445437824:12345-0@lo:38:kworker.0 00000020:01000000:0.0:1788359487.632615:0:17924:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788359487.632618:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788359487.632629:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffffa0eaffa419c0) 00000020:00000080:0.0:1788359487.632640:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788359487.632644:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788359487.632687:0:17924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788359487.632694:0:17924:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788359487.632701:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf715 00010000:00080000:0.0:1788359487.632726:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaf95cd800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.152@tcp at head 00000100:00100000:3.0:1788359487.632733:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1875230445437824:12345-0@lo:38:kworker.0 Request processed in 58us (355us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788359487.632742:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788359487.632813:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788359487.632821:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788359487.632825:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788359487.632829:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445437824:0@lo:38:kworker.0 00010000:00010000:0.0:1788359487.632920:0:17924:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788359487.635362:0:17924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788359487.635579:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788359487.638013:0:17194:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6354800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359487.638231:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445437696:12345-0@lo:38:llog_process_th.0 Request processed in 6200us (6349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.638242:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359487.638319:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788359487.638328:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788359487.638336:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788359487.638342:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788359487.638344:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6315000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788359487.638368:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445437696:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788359487.638553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359487.638567:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445438080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359487.638618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.639082:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438080 00000100:00100000:1.0:1788359487.639088:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438080 00000100:00100000:1.0:1788359487.639129:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359487.639138:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445438080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359487.639164:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788359487.639223:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1875230445438080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359487.639230:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359487.639274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445438080:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788359487.642396:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359487.642754:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788359487.642860:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1788359487.644575:0:17930:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788359487.644582:0:17930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788359487.647301:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788359487.647316:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788359487.647357:0:17924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788359487.647383:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf71c 00000100:00080000:3.0:1788359487.647395:0:17924:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359487.647404:0:17924:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa0eaf95cd800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359487.647441:0:17924:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9180 x1875230445438208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359487.647515:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445438208:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788359487.647570:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445438208 offset 0 length 520: 4 00000100:00080000:3.0:1788359487.647678:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788359487.647724:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359487.647727:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.647728:0:17924:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788359487.647730:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788359487.647736:0:17924:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788359487.647737:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359487.647738:0:17924:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788359487.647739:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788359487.647740:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.647741:0:17924:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788359487.647743:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788359487.647746:0:17924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788359487.647748:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.647749:0:17924:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788359487.647750:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788359487.647753:0:17924:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.152@tcp to nid 0x20000c0a8ca98 (192.168.202.152@tcp) 00000020:01000000:3.0:1788359487.647768:0:17924:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788359487.647770:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788359487.647778:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffffa0eac685cd40) 00000020:00000080:3.0:1788359487.647787:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788359487.647790:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788359487.647837:0:17924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788359487.647842:0:17924:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788359487.647845:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x49dd053b5feaf72a 00010000:00080000:3.0:1788359487.647872:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eac4a8e800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359487.648001:0:17924:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788359487.648067:0:17924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788359487.648081:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788359487.648548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.648552:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359487.648554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.648556:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788359487.649668:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788359487.650275:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788359487.650413:0:17924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788359487.650740:0:17932:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788359487.650744:0:17932:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788359487.651230:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788359487.651240:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788359487.651277:0:17924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788359487.651298:0:17924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf731 00000100:00080000:3.0:1788359487.651307:0:17924:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359487.651319:0:17924:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359487.651350:0:17924:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27bb800 x1875230445438336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788359487.651399:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445438336:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788359487.651438:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445438336 offset 0 length 520: 4 00000100:00080000:3.0:1788359487.651485:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788359487.651543:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359487.651545:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.651547:0:17924:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788359487.651549:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359487.651551:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.651552:0:17924:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788359487.651554:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788359487.651555:0:17924:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788359487.651557:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359487.651558:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.651558:0:17924:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788359487.651560:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359487.651561:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.651561:0:17924:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788359487.651563:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788359487.651578:0:17924:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359487.651580:0:17924:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359487.651581:0:17924:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788359487.651583:0:17924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:3.0:1788359487.651647:0:17920:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788359487.651670:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788359487.651682:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ba expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.651689:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0030800/0x49dd053b5feaf6b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf6ba expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359487.651695:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaffa8a000 from 1 10000000:01000000:3.0:1788359487.651700:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359487.651720:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.651725:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.651732:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359487.651742:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788359487.651769:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.651784:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00080000:2.0:1788359487.651876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.651879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359487.651885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.651887:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359487.651903:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438464 00000100:00100000:2.0:1788359487.651907:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438464 00000100:00100000:2.0:1788359487.651941:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788359487.651947:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+15:17920:x1875230445438464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359487.651958:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359487.651968:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf738 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.651985:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 16 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.651992:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 16 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.651998:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb200, rc 0) 00000100:00100000:2.0:1788359487.652029:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17920:x1875230445438464:12345-0@lo:101:mount.lustre.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.652036:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788359487.652106:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.652116:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.652122:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359487.652565:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438592:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788359487.652592:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.652611:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.652652:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438592 00000100:00100000:2.0:1788359487.652655:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438592 00000100:00100000:2.0:1788359487.652677:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359487.652682:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17920:x1875230445438592:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788359487.652691:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788359487.652703:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788359487.652705:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788359487.652753:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17920:x1875230445438592:12345-0@lo:256:mount.lustre.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.652760:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788359487.652886:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438592:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788359487.653400:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359487.653420:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653439:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359487.653446:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaffa8a000 from 1 10000000:01000000:3.0:1788359487.653449:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359487.653461:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653466:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653471:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359487.653478:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788359487.653522:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.653535:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.653546:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438720 00000100:00100000:3.0:1788359487.653548:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438720 00000100:00100000:3.0:1788359487.653566:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359487.653570:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17920:x1875230445438720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.653575:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359487.653582:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf746 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653597:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653614:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653621:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6a00, rc 0) 00000100:00100000:3.0:1788359487.653645:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445438720:12345-0@lo:101:mount.lustre.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.653649:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788359487.653672:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.653679:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.653684:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788359487.653764:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788359487.653782:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359487.653802:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.653818:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.653829:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438848 00000100:00100000:3.0:1788359487.653832:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438848 00000100:00100000:3.0:1788359487.653852:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359487.653857:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445438848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359487.653926:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445438848:12345-0@lo:501:mount.lustre.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.653932:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359487.653959:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359487.653982:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788359487.654006:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.654015:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.654023:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445438976 00000100:00100000:3.0:1788359487.654025:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445438976 00000100:00100000:3.0:1788359487.654037:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788359487.654040:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445438976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788359487.654090:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445438976:12345-0@lo:503:mount.lustre.0 Request processed in 49us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.654094:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788359487.654118:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445438976:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788359487.654405:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788359487.654445:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359487.654467:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.654477:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.654486:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439104 00000100:00100000:3.0:1788359487.654488:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439104 00000100:00100000:3.0:1788359487.654519:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788359487.654523:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445439104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359487.654579:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445439104:12345-0@lo:502:mount.lustre.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.654585:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788359487.654623:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359487.654768:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788359487.654792:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788359487.654816:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788359487.654829:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788359487.654842:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788359487.654853:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788359487.654863:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788359487.654875:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788359487.654889:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788359487.654902:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788359487.654914:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788359487.654944:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359487.654974:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.654993:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.655006:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439232 00000100:00100000:3.0:1788359487.655009:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439232 00000100:00100000:3.0:1788359487.655028:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359487.655034:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445439232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359487.655091:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445439232:12345-0@lo:502:mount.lustre.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.655098:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359487.655134:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359487.655163:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788359487.655183:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788359487.655529:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.655536:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655538:0:17934:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788359487.655543:0:17934:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaffa8a000 00000020:00000080:1.0:1788359487.655545:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359487.655550:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359487.655552:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655553:0:17934:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788359487.655554:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.655555:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655556:0:17934:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788359487.655558:0:17934:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eaffa8a000 00000020:00000080:1.0:1788359487.655559:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359487.655602:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359487.655604:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655605:0:17934:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788359487.655606:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.655608:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655609:0:17934:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788359487.655611:0:17934:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaffa8a000 00000020:00000080:1.0:1788359487.655613:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359487.655635:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359487.655638:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655639:0:17934:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788359487.655642:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359487.655644:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655645:0:17934:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788359487.655649:0:17934:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eaffa8a000 00000020:00000080:1.0:1788359487.655650:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788359487.655670:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359487.655674:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359487.655675:0:17934:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788359487.655677:0:17934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788359487.659259:0:17920:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788359487.659301:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359487.659321:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659333:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359487.659409:0:17920:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788359487.659413:0:17920:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eaffa8a000 10000000:01000000:3.0:1788359487.659418:0:17920:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eaffa8a000 10000000:01000000:3.0:1788359487.659423:0:17920:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788359487.659428:0:17920:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eaffa8a000 from 1 10000000:01000000:3.0:1788359487.659430:0:17920:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788359487.659465:0:17920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659472:0:17920:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659483:0:17920:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359487.659527:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788359487.659592:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.659630:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.659654:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439360 00000100:00100000:3.0:1788359487.659661:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439360 00000100:00100000:3.0:1788359487.659703:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359487.659711:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17920:x1875230445439360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788359487.659723:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359487.659734:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6e00/0x49dd053b5feaf75b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf754 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659754:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6e00/0x49dd053b5feaf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf754 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659775:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6e00/0x49dd053b5feaf75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf754 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359487.659781:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6e00, rc 0) 00000100:00100000:3.0:1788359487.659826:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439360:12345-0@lo:101:mount.lustre.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.659833:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788359487.667375:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359487.667405:0:17920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf75b expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.667418:0:17920:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf75b expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788359487.670860:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788359487.671136:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359487.671311:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788359487.671336:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788359487.671352:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788359487.671366:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788359487.671389:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788359487.671397:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788359487.671404:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788359487.671411:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788359487.671419:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788359487.671425:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788359487.671432:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788359487.671454:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788359487.671463:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788359487.671470:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788359487.671479:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788359487.671486:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788359487.671510:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788359487.671524:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788359487.671532:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788359487.671539:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788359487.671555:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788359487.671566:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788359487.671572:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788359487.671579:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788359487.671586:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788359487.671593:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788359487.671602:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788359487.671609:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788359487.671619:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788359487.671622:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788359487.671687:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359487.671742:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.671782:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.671813:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439488 00000100:00100000:2.0:1788359487.671821:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439488 00000100:00100000:2.0:1788359487.671873:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788359487.671882:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359487.672009:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439488:12345-0@lo:501:mount.lustre.0 Request processed in 127us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.672017:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788359487.672564:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359487.672601:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359487.672643:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.672733:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a79600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359487.672937:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439616 00000100:00100000:0.0:1788359487.672943:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439616 00000100:00100000:0.0:1788359487.672995:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788359487.673005:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439616:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359487.673123:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439616:12345-0@lo:503:mount.lustre.0 Request processed in 120us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.673131:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788359487.673184:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439616:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788359487.673562:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359487.673617:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359487.673658:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.673852:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.676523:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439744 00000100:00100000:2.0:1788359487.676536:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439744 00000100:00100000:2.0:1788359487.676600:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788359487.676612:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359487.676787:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439744:12345-0@lo:502:mount.lustre.0 Request processed in 178us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.676796:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788359487.676823:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359487.677077:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788359487.677228:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788359487.677246:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788359487.677257:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788359487.677273:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788359487.677302:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788359487.677320:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788359487.677334:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788359487.677348:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788359487.677360:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788359487.677382:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788359487.677398:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788359487.677413:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788359487.677430:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788359487.677446:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788359487.677467:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788359487.677487:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000100:00100000:0.0:1788359487.677518:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000040:00080000:1.0:1788359487.677566:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788359487.677592:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788359487.677612:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788359487.677632:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788359487.677661:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788359487.677688:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788359487.677708:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788359487.677726:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788359487.677742:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788359487.677758:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788359487.677778:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788359487.677806:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788359487.677825:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788359487.677839:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788359487.677852:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788359487.677865:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788359487.677879:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788359487.677892:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788359487.677904:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788359487.677915:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788359487.677940:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788359487.677957:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788359487.677969:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788359487.677982:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788359487.677997:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788359487.678010:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788359487.678023:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788359487.678035:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788359487.678046:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788359487.678072:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788359487.678101:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788359487.678150:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359487.678214:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.678253:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4a790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359487.678263:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445439872 00000100:00100000:0.0:1788359487.678271:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445439872 00000100:00100000:0.0:1788359487.678313:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788359487.678321:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788359487.678424:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445439872:12345-0@lo:502:mount.lustre.0 Request processed in 104us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.678432:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788359487.678482:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445439872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788359487.678642:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788359487.678664:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788359487.678685:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445440000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788359487.678789:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359487.678808:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.678826:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440000 00000100:00100000:2.0:1788359487.678832:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440000 00000100:00100000:2.0:1788359487.678866:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788359487.678873:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445440000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359487.678957:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445440000:12345-0@lo:502:mount.lustre.0 Request processed in 83us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.678964:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788359487.679056:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445440000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788359487.679109:0:17920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788359487.679118:0:17920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788359487.679905:0:17939:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788359487.679922:0:17939:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffffa0eaf58d3380) 00000020:00000080:1.0:1788359487.679947:0:17939:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788359487.680294:0:17939:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eaffa8a000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788359487.680299:0:17939:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eaffa8a000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788359487.680302:0:17939:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eaffa8a000 3 00010000:00080000:1.0:1788359487.680328:0:17939:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eac5e98800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359487.683995:0:17939:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788359487.684133:0:17939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788359487.684197:0:17939:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788359487.684212:0:17939:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x49dd053b5feaf769 00000100:00080000:1.0:1788359487.684226:0:17939:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359487.684233:0:17939:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffffa0eac5e98800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359487.684270:0:17939:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80eca80 x1875230445440128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359487.684298:0:17939:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788359487.684320:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445440128:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359487.684394:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.684435:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440128 00000100:00100000:3.0:1788359487.684444:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440128 00000100:00100000:3.0:1788359487.684557:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359487.684565:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445440128:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788359487.684591:0:17189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788359487.684627:0:17189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x49dd053b5feaf770 00000004:00100000:3.0:1788359487.684643:0:17189:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788359487.684675:0:17189:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a89800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359487.684738:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875230445440128:12345-0@lo:38:llog_process_th.0 Request processed in 172us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.684745:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788359487.684806:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0e9c80eca80 x1875230445440128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359487.684816:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788359487.684823:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788359487.684829:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788359487.684834:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788359487.684836:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac5e98800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788359487.684848:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875230445440128:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788359487.686590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.686600:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359487.686604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359487.686617:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788359487.687081:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788359487.687128:0:17920:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788359487.687156:0:17920:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359487.687185:0:17920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf75b expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.687198:0:17920:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7000/0x49dd053b5feaf754 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf75b expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788359487.687257:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788359487.687259:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788359487.687261:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359487.687262:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359487.687263:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359487.687265:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359487.687266:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359487.687268:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359487.687270:0:17920:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359487.687274:0:17920:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788359487.687277:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359487.687278:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788359487.687280:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359487.687281:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359487.687282:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359487.687284:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359487.687285:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788359487.687286:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359487.687287:0:17920:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359487.687313:0:17920:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788359487.687333:0:17920:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445440256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788359487.687404:0:17920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359487.687439:0:17920:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359487.687635:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440256 00000100:00100000:1.0:1788359487.687642:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440256 00000100:00100000:1.0:1788359487.687790:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788359487.687802:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445440256:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788359487.687831:0:17183:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788359487.687844:0:17183:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788359487.689589:0:17169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788359487.690259:0:17183:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788359487.690279:0:17183:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788359487.690463:0:17205:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788359487.690479:0:17205:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788359487.690520:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.690537:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 18 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.690544:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.690552:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.690588:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17920:x1875230445440256:12345-0@lo:253:mount.lustre.0 Request processed in 2786us (3180us total) trans 0 rc 0/0 00010000:00010000:2.0:1788359487.690589:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.690609:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788359487.690614:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 18 pid: 17183 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359487.690627:0:17920:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:17920:1875230445440256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788359487.690631:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445440384:0@lo:104: 10000000:01000000:0.0:1788359487.690641:0:17920:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788359487.690644:0:17920:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359487.690646:0:17920:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788359487.690648:0:17920:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359487.690649:0:17920:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359487.690650:0:17920:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359487.690651:0:17920:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359487.690652:0:17920:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788359487.690654:0:17920:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359487.690655:0:17920:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788359487.690666:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788359487.690691:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.690696:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 17 pid: 17184 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359487.690701:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445440512:0@lo:104: 00000100:00100000:2.0:1788359487.690713:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359487.690731:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a0f480 going to sleep for 11 seconds 00000020:02000000:0.0:1788359487.690746:0:17920:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788359487.691101:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440384 00000100:00100000:1.0:1788359487.691107:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440384 00000100:00100000:1.0:1788359487.691130:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440512 00000100:00100000:1.0:1788359487.691132:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440512 00000100:00100000:1.0:1788359487.691144:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359487.691150:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+4:17205:x1875230445440384:12345-0@lo:104: 00010000:00010000:1.0:1788359487.691163:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691227:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359487.691239:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+4:17205:x1875230445440384:12345-0@lo:104: Request processed in 88us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359487.691245:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359487.691259:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359487.691266:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445440512:12345-0@lo:104: 00010000:00010000:1.0:1788359487.691275:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691305:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788359487.691310:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445440512:12345-0@lo:104: Request processed in 46us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359487.691315:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788359487.691332:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359487.691338:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691346:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359487.691350:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691358:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359487.691366:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.691372:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359487.691399:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691418:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359487.691439:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691445:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf73f expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691458:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359487.691462:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691468:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac0031c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:1.0:1788359487.691471:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691477:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788359487.691483:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359487.691488:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788359487.691545:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691552:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788359487.691568:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691574:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac0031c00/0x49dd053b5feaf674 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf67b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691594:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359487.691596:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359487.691598:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359487.691606:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359487.691625:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445440640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359487.691657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.691715:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445440768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359487.691740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359487.691778:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440640 00000100:00100000:1.0:1788359487.691782:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440640 00010000:00010000:1.0:1788359487.691802:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 18 pid: 17183 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.691824:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440768 00000100:00100000:1.0:1788359487.691828:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440768 00010000:00010000:1.0:1788359487.691841:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 19 pid: 17184 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359487.691857:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359487.691865:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3645:x1875230445440640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359487.691875:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359487.691880:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 19 pid: 17183 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691891:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 19 pid: 17183 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691906:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359487.691943:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3645:x1875230445440640:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359487.691950:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359487.691964:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359487.691970:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:3642:x1875230445440768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359487.691977:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359487.691982:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 18 pid: 17184 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.691992:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 18 pid: 17184 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692004:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692013:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788359487.692025:0:17174:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003752711s 00010000:00010000:1.0:1788359487.692029:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692036:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692043:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692050:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692066:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359487.692071:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692079:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692087:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359487.692096:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359487.692121:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+18:3642:x1875230445440768:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359487.692127:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359487.692163:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445440768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359487.692199:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445440640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359487.692332:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf73f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf738 expref: 17 pid: 17183 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359487.692369:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445440384:0@lo:104: 00010000:00010000:2.0:1788359487.692385:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feaf67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf674 expref: 16 pid: 17184 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359487.692394:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445440512:0@lo:104: 00010000:00010000:2.0:1788359487.692420:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.692430:0:17205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.692437:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359487.692444:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75ebc00/0x49dd053b5feaf777 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:1.0:1788359487.697926:0:17920:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788359487.698127:0:17945:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788359487.698132:0:17945:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788359487.698201:0:17946:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788359487.698213:0:17920:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788359487.698630:0:17947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445440896:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788359487.698690:0:17920:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:3.0:1788359487.698700:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788359487.698718:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788359487.698739:0:17947:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2da2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.698747:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445440896 00000100:00100000:2.0:1788359487.698756:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445440896 00000100:00100000:2.0:1788359487.698868:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359487.698879:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445440896:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788359487.698945:0:17946:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788359487.698962:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445440896:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.698970:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788359487.699125:0:17947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445440896:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788359487.699150:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788359487.699186:0:17947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445441024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.699215:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.699239:0:17947:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2da2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359487.699277:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441024 00000100:00100000:2.0:1788359487.699281:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441024 00000100:00100000:2.0:1788359487.699344:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359487.699351:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445441024:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788359487.699729:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445441024:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 378us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359487.699736:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788359487.700765:0:17947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445441024:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.701588:0:17947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875230445441152:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.701635:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.701671:0:17947:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2da20c0 going to sleep for 11 seconds 00000004:00000080:1.0:1788359487.701954:0:17920:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:0.0:1788359487.703421:0:17946:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788359487.703527:0:17946:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788359487.703548:0:17920:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:0.0:1788359487.703591:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441152 00000100:00100000:0.0:1788359487.703603:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441152 00000100:00100000:0.0:1788359487.703657:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788359487.703661:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359487.703670:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875230445441152:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788359487.703761:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17947:x1875230445441152:12345-0@lo:900:lod0001_rec0000.0 Request processed in 95us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359487.703771:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788359487.703800:0:17947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0ead27ba300 x1875230445441152/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788359503 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359487.703886:0:17947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17947:1875230445441152:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.703964:0:17947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445441280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.704003:0:17947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359487.704033:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441280 00000100:00100000:3.0:1788359487.704037:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441280 00000100:00100000:3.0:1788359487.704139:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788359487.704154:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445441280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788359487.704231:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17947:x1875230445441280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359487.704240:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788359487.704266:0:17947:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac2da2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788359487.704283:0:17947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17947:1875230445441280:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788359487.704332:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788359487.704908:0:17920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788359487.707519:0:17920:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788359487.707612:0:17920:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788359487.707786:0:17920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788359487.708293:0:17920:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1788359487.709554:0:17920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:3.0:1788359487.709717:0:17947:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788359487.709782:0:17947:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788359487.709787:0:17947:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788359487.714981:0:17920:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788359487.715013:0:17920:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb78b4554f988 00100000:10000000:0.0:1788359487.715022:0:17920:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788359487.715694:0:17920:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788359487.715725:0:17920:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788359487.715745:0:17920:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788359487.715761:0:17920:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788359487.716520:0:17920:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359487.716699:0:17920:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359488.380631:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359488.700595:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000040:00080000:3.0:1788359488.706704:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788359489.342972:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359489.342979:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaffa8a000 from 8 10000000:01000000:2.0:1788359489.342984:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359489.343031:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359489.343043:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359489.343053:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359489.343079:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359489.343146:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359489.343212:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c734e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788359489.343265:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441408 00000100:00100000:3.0:1788359489.343273:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441408 00000100:00100000:3.0:1788359489.343329:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788359489.343339:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17186:x1875230445441408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359489.343352:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359489.343367:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf77e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.343390:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.343400:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 17 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.343409:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359489.343454:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445441408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359489.343471:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788359489.343748:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359489.343764:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.343773:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359489.343826:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788359489.343860:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359489.343883:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788359489.343898:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441536 00000100:00100000:3.0:1788359489.343902:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441536 00000100:00100000:3.0:1788359489.343926:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359489.343933:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445441536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788359489.343947:0:17183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788359489.343962:0:17183:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788359489.343966:0:17183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788359489.344045:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445441536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359489.344052:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788359489.344084:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788359489.344124:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359489.344131:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344149:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359489.344171:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788359489.344174:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0ead20a0000 from 8 10000000:01000000:3.0:1788359489.344176:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359489.344192:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344199:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344207:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359489.344220:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359489.344247:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359489.344261:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788359489.344273:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441664 00000100:00100000:3.0:1788359489.344277:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441664 00000100:00100000:3.0:1788359489.344299:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359489.344306:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445441664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359489.344313:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359489.344321:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf78c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344335:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344354:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344362:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:3.0:1788359489.344392:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445441664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359489.344399:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788359489.344429:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359489.344440:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344448:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359489.344492:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788359489.344551:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359489.344574:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4c7f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788359489.344587:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441792 00000100:00100000:3.0:1788359489.344591:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441792 00000100:00100000:3.0:1788359489.344614:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788359489.344621:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445441792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788359489.344632:0:17183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788359489.344645:0:17183:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788359489.344648:0:17183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788359489.344721:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445441792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359489.344737:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788359489.344769:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445441792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788359489.344803:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359489.344809:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359489.344816:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359489.404838:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359489.724789:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 0 seconds 00000100:00100000:0.0:1788359489.730249:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359479/real 1788359479] req@ffffa0ead27bbb80 x1875230445433344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359489.730297:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27bbb80 x1875230445433344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359489.730308:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359479/real 1788359479] req@ffffa0ead27b8700 x1875230445433216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359489.730320:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27b8700 x1875230445433216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788359489.730341:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359489.730368:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788359489.730373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433344:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788359489.730379:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb006a7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359489.730383:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788359489.730386:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445433216:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788359489.730567:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788359489.730572:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788359489.730574:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359489.730583:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffffa0eae4c86800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359489.730615:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8124e00 x1875230445441920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788359489.730641:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359489.730645:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788359489.730647:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eb006a7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359489.730650:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1788359489.730661:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788359489.730665:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0eb006a7000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359489.730678:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8126680 x1875230445442048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788359489.730687:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359489.730689:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788359489.730691:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788359489.730694:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:0.0:1788359489.730696:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788359489.730699:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0eb0068a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:0.0:1788359489.730710:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c8127100 x1875230445442176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788359489.730745:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359489.730749:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788359489.730752:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359489.730756:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788359489.730813:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445442304:0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.730862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359489.730918:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445442432:0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.730938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359489.730954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359489.730957:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445442560:0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.730971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359489.730992:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442432 00000100:00100000:1.0:1788359489.730997:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442432 00000100:00100000:1.0:1788359489.731028:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359489.731034:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445442432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.731070:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445442432:12345-0@lo:400:kworker.0 Request processed in 36us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359489.731074:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359489.731088:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442304 00000100:00100000:1.0:1788359489.731090:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442304 00000100:00100000:1.0:1788359489.731104:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442560 00000100:00100000:1.0:1788359489.731105:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442560 00000100:00100000:1.0:1788359489.731112:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359489.731115:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445442304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.731134:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445442304:12345-0@lo:400:kworker.0 Request processed in 19us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359489.731143:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359489.731165:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359489.731171:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445442560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.731204:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445442560:12345-0@lo:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359489.731210:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788359489.731243:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c8125180 x1875230445442560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359489.731256:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445442560:0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.731265:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445442432:0@lo:400:kworker.0 00010000:00080000:1.0:1788359489.731288:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c8125f80 x1875230445442304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359489.731297:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445442304:0@lo:400:kworker.0 00000100:00100000:1.0:1788359489.731311:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445441920:0@lo:38:kworker.0 00000100:00100000:1.0:1788359489.731333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359489.731354:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445442048:0@lo:8:kworker.0 00000400:00000100:1.0:1788359489.731373:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445442048 offset 0 length 520: 4 00000100:00100000:1.0:1788359489.731388:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445442176:0@lo:8:kworker.0 00000400:00000100:1.0:1788359489.731403:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875230445442176 offset 0 length 520: 4 00000100:00100000:1.0:1788359489.731421:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445441920 00000100:00100000:1.0:1788359489.731424:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445441920 00000100:00100000:1.0:1788359489.731440:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359489.731445:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1875230445441920:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788359489.731473:0:17194:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1788359489.731539:0:17194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf79a 00000004:00100000:1.0:1788359489.731554:0:17194:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788359489.731561:0:17194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1788359489.734567:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788359489.737024:0:17194:0:(import.c:65:import_set_state_nolock()) ffffa0eac683a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359489.737122:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445441920:12345-0@lo:38:kworker.0 Request processed in 5673us (5785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359489.737133:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788359489.737186:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788359489.737196:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788359489.737202:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788359489.737205:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eae4c86800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788359489.737228:0:3641:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007d5507de): req@ffffa0ead28dd500 x1875230445435776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359489.737254:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445441920:0@lo:38:kworker.0 00000100:00100000:2.0:1788359489.737468:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359489.737490:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788359489.737519:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445435776 00000100:00100000:2.0:1788359489.737524:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445435776 00000100:00100000:2.0:1788359489.737557:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359489.737571:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445435776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.737633:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445435776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359489.737641:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359489.737664:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17231:1875230445435776:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788359489.737692:0:17231:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788359489.737720:0:17231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17231:1875230445442816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.737746:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359489.737768:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359489.737780:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442816 00000100:00100000:2.0:1788359489.737784:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442816 00000100:00100000:2.0:1788359489.737803:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359489.737809:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445442816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.737890:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445442816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359489.737897:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359489.737919:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17231:1875230445442816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.737974:0:17231:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17231:1875230445442944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.737996:0:17231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359489.738009:0:17231:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359489.738019:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442944 00000100:00100000:2.0:1788359489.738022:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442944 00000100:00100000:2.0:1788359489.738041:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359489.738046:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445442944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788359489.738085:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17231:x1875230445442944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359489.738096:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359489.738121:0:17231:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17231:1875230445442944:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788359489.738167:0:17231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359489.740443:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788359489.740523:0:17231:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 10, retries 0 00000004:00080000:2.0:1788359489.740528:0:17231:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788359489.740668:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788359489.740688:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445442688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359489.740752:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359489.741042:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445442688 00000100:00100000:2.0:1788359489.741050:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445442688 00000100:00100000:2.0:1788359489.741101:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359489.741110:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445442688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359489.741145:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788359489.741303:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445442688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359489.741308:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788359489.741370:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445442688:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788359490.244816:0:18191:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788359490.429779:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788359490.834486:0:18243:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359490.834847:0:18243:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788359491.369954:0:18293:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359491.370255:0:18293:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359491.452639:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788359491.775020:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788359492.077469:0:18341:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0a39a0a0 20000000:00000080:1.0:1788359492.077489:0:18341:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0eaec37c400 uarg=0000000000000000 20000000:01000000:1.0:1788359492.077758:0:18341:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788359492.077766:0:18341:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788359492.077771:0:18341:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788359492.078300:0:18342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788359492.078464:0:18341:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788359492.085460:0:18341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788359492.086696:0:18341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086719:0:18341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086726:0:18341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086733:0:18341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086775:0:18341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086806:0:18341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 17 pid: 17183 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359492.086822:0:18341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18341:1875230445443072:0@lo:104: 00000100:00100000:3.0:1788359492.086884:0:18341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359492.086938:0:18341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.086946:0:18341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359492.086954:0:18341:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18341:1875230445443200:0@lo:104: 00000100:00100000:3.0:1788359492.086974:0:18341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359492.087002:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443072 00000100:00100000:3.0:1788359492.087009:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443072 00000100:00100000:3.0:1788359492.087044:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443200 00000100:00100000:3.0:1788359492.087047:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443200 00000100:00100000:3.0:1788359492.087060:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359492.087068:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+4:18341:x1875230445443072:12345-0@lo:104: 00010000:00010000:3.0:1788359492.087464:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.087541:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788359492.087548:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+4:18341:x1875230445443072:12345-0@lo:104: Request processed in 480us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359492.087555:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359492.087572:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788359492.087578:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:18341:x1875230445443200:12345-0@lo:104: 00010000:00010000:3.0:1788359492.087592:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.087622:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788359492.087627:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:18341:x1875230445443200:12345-0@lo:104: Request processed in 50us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359492.087633:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788359492.087656:0:18341:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788359492.088050:0:18341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18341:1875230445443072:0@lo:104: 00000100:00100000:3.0:1788359492.088060:0:18341:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18341:1875230445443200:0@lo:104: 00010000:00010000:3.0:1788359492.088079:0:18341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088152:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359492.088160:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088167:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7a00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359492.088171:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088188:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359492.088195:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359492.088201:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788359492.088232:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088239:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359492.088263:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088271:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7a00/0x49dd053b5feaf746 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf74d expref: -99 pid: 17920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088282:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359492.088285:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088291:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8000 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359492.088294:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088301:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359492.088307:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359492.088318:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788359492.088330:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088335:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359492.088346:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088352:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feaf643 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf64a expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.088364:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359492.088366:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359492.088368:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359492.088374:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359492.088465:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445443328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359492.088525:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359492.088565:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445443456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359492.088593:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359492.088640:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443328 00000100:00100000:1.0:1788359492.088645:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443328 00010000:00010000:1.0:1788359492.088671:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 18 pid: 17183 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359492.088690:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443456 00000100:00100000:1.0:1788359492.088693:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443456 00010000:00010000:1.0:1788359492.088703:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 19 pid: 17182 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359492.088715:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359492.088720:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3643:x1875230445443328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359492.088730:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359492.088735:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 19 pid: 17183 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088743:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 19 pid: 17183 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088756:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad6a00/0x49dd053b5feaf74d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf746 expref: 19 pid: 17183 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088767:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359492.088792:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:3643:x1875230445443328:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359492.088798:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359492.088811:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359492.088816:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:3644:x1875230445443456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788359492.088830:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359492.088835:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088843:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088852:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf64a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf643 expref: 17 pid: 17182 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088862:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088869:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088882:0:17175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088890:0:17175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088896:0:17175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088903:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088908:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359492.088912:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088930:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088942:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359492.088952:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359492.088978:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+16:3644:x1875230445443456:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359492.088984:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359492.089010:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445443456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788359492.089028:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445443328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359492.089238:0:18341:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.089246:0:18341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359492.089252:0:18341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7800/0x49dd053b5feaf7a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359492.476636:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359492.797000:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445443584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788359492.797078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359492.797258:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443584 00000100:00100000:3.0:1788359492.797267:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443584 00000100:00100000:3.0:1788359492.797317:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359492.797326:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445443584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359492.797362:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788359492.797458:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445443584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359492.797474:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359492.799628:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445443584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359493.501741:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788359493.693800:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359493.693808:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaffa8a000 from 13 10000000:01000000:3.0:1788359493.693812:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359493.693863:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359493.693876:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359493.693888:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359493.693916:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359493.693986:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359493.694036:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead28c2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788359493.694092:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443712 00000100:00100000:1.0:1788359493.694100:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443712 00000100:00100000:1.0:1788359493.694165:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788359493.694175:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+16:17186:x1875230445443712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359493.694188:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359493.694203:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf7a8 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359493.694226:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359493.694237:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 17 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359493.694261:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0030200, rc 0) 00000100:00100000:1.0:1788359493.694309:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445443712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359493.694316:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788359493.694392:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359493.694406:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.694414:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359493.694474:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.694528:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359493.694546:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359493.694593:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443840 00000100:00100000:1.0:1788359493.694597:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443840 00000100:00100000:1.0:1788359493.694632:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788359493.694638:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445443840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359493.694732:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445443840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359493.694738:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788359493.694793:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.694831:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.694868:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359493.694888:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788359493.694901:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445443968 00000100:00100000:2.0:1788359493.694905:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445443968 00000100:00100000:2.0:1788359493.694923:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359493.694927:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445443968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.695009:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445443968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359493.695016:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788359493.695055:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445443968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788359493.695706:0:18472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788359493.695756:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788359493.695774:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359493.695781:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.695790:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359493.695799:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359493.695801:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0ead20a0000 from 13 10000000:01000000:2.0:1788359493.695804:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359493.695823:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.695829:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.695847:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359493.695860:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.695889:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359493.695904:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359493.695919:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444096 00000100:00100000:2.0:1788359493.695923:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444096 00000100:00100000:2.0:1788359493.695943:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359493.695950:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+17:17186:x1875230445444096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359493.695957:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359493.695966:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf7b6 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.695984:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.695993:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 18 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.696000:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb200, rc 0) 00000100:00100000:2.0:1788359493.696030:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445444096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359493.696036:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788359493.696067:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359493.696078:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.696094:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359493.696147:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.696170:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359493.696183:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359493.696195:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444224 00000100:00100000:2.0:1788359493.696198:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444224 00000100:00100000:2.0:1788359493.696215:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788359493.696220:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445444224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.696294:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445444224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359493.696301:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788359493.696330:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.696355:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.696387:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359493.696401:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359493.696412:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444352 00000100:00100000:2.0:1788359493.696415:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444352 00000100:00100000:2.0:1788359493.696431:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788359493.696437:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445444352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359493.696521:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:17186:x1875230445444352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359493.696528:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788359493.696570:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445444352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788359493.697277:0:18473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788359493.697322:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788359493.697341:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359493.697349:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359493.697359:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359494.524828:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788359494.844662:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359494.844672:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788359494.844677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359494.844680:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359494.844695:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445444480:0@lo:400:kworker.0 00000100:00080000:0.0:1788359494.844704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359494.844708:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788359494.844711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788359494.844720:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359494.844786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359494.844801:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445444608:0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.844834:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359494.844842:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445444992:0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.844865:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445444864:0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.844870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359494.844886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359494.844903:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359494.844909:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445444736:0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.844940:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444608 00000100:00100000:0.0:1788359494.844948:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444608 00000100:00100000:0.0:1788359494.844989:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444864 00000100:00100000:0.0:1788359494.844992:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444864 00000100:00100000:0.0:1788359494.845009:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359494.845016:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445444608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.845034:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444480 00000100:00100000:2.0:1788359494.845038:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444480 00000100:00100000:2.0:1788359494.845067:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788359494.845071:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445444608:12345-0@lo:400:kworker.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359494.845073:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:3642:x1875230445444480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.845078:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788359494.845096:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788359494.845114:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445444864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.845115:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:3642:x1875230445444480:12345-0@lo:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359494.845121:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788359494.845141:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445444864:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359494.845146:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359494.845148:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444992 00000100:00100000:2.0:1788359494.845151:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444992 00000100:00100000:0.0:1788359494.845163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359494.845363:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445444736 00000100:00100000:2.0:1788359494.845367:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445444736 00000100:00100000:2.0:1788359494.845386:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359494.845395:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445444864:0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.845403:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445444992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.845423:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788359494.845431:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788359494.845541:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445444608:0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.845581:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359494.845588:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445444736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.845818:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445444992:12345-0@lo:400:kworker.0 Request processed in 415us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359494.845819:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445444736:12345-0@lo:400:kworker.0 Request processed in 232us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359494.845826:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359494.845829:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788359494.845855:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c8127b80 x1875230445444992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788359494.845855:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c8124e00 x1875230445444736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359494.845867:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445444992:0@lo:400:kworker.0 00000100:00100000:0.0:1788359494.845867:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445444736:0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.845876:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445444480:0@lo:400:kworker.0 00000100:00100000:2.0:1788359494.846203:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359494.846224:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445445120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359494.846407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359494.846533:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445120 00000100:00100000:3.0:1788359494.846539:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445120 00000100:00100000:3.0:1788359494.846566:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788359494.846573:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445445120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359494.846598:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788359494.846635:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875230445445120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359494.846641:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359494.846948:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445445120:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788359495.550004:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788359495.869971:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:01000004:2.0:1788359496.127459:0:18691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788359496.127463:0:18691:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788359496.127465:0:18691:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788359496.127653:0:18691:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0eac6839000 00000020:01000004:2.0:1788359496.127671:0:18691:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788359496.127685:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788359496.127700:0:18691:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0eaece13380) 00000020:00000080:2.0:1788359496.127720:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788359496.181377:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788359496.182420:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788359496.182669:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788359496.182944:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788359496.183404:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788359496.184674:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788359496.185003:0:18691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788359496.192077:0:18691:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788359496.192319:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788359496.192332:0:18691:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788359496.192343:0:18691:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49dd053b5feaf7cb 00000020:01000004:2.0:1788359496.192350:0:18691:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788359496.192373:0:18691:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788359496.192377:0:18691:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788359496.192390:0:18691:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788359496.192396:0:18691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788359496.192407:0:18691:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0eaece10000) 00000020:00000080:2.0:1788359496.192419:0:18691:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788359496.193776:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788359496.193940:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788359496.193946:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788359496.194867:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788359496.194876:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788359496.195186:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788359496.195193:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788359496.198666:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788359496.198873:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788359496.198880:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788359496.199907:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788359496.199917:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788359496.223396:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788359496.223980:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788359496.223987:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788359496.229302:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788359496.229318:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788359496.230221:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788359496.230231:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788359496.232205:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788359496.232383:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788359496.232390:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788359496.233037:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788359496.233045:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788359496.259258:0:18691:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788359496.259468:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788359496.259474:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788359496.260941:0:18691:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788359496.260953:0:18691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788359496.261698:0:18691:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788359496.261729:0:18691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788359496.261736:0:18691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788359496.271448:0:18691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788359496.271650:0:18691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.152@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788359496.271655:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788359496.271656:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788359496.271657:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359496.271659:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359496.271660:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359496.271661:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359496.271662:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788359496.271664:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359496.271665:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359496.271669:0:18691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788359496.271671:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788359496.271672:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788359496.271673:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359496.271674:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359496.271675:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359496.271676:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359496.271677:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788359496.271678:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359496.271679:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788359496.271704:0:18691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788359496.271725:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445248:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788359496.271803:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.271903:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687c000 going to sleep for 11 seconds 00000100:00100000:3.0:1788359496.271998:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445248 00000100:00100000:3.0:1788359496.272006:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445248 00000100:00100000:3.0:1788359496.272107:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788359496.272118:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:18691:x1875230445445248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788359496.272148:0:17184:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788359496.272152:0:17184:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788359496.272156:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788359496.272488:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+18:18691:x1875230445445248:12345-0@lo:253:mount.lustre.0 Request processed in 371us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359496.272514:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788359496.272610:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788359496.272620:0:18691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788359496.272622:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788359496.272623:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788359496.272624:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788359496.272625:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788359496.272626:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788359496.272634:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788359496.272635:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788359496.272636:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788359496.272637:0:18691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788359496.272659:0:18691:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0eac6839000 from lustre-OST0000 10000000:01000000:1.0:1788359496.272682:0:18691:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788359496.272685:0:18691:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788359496.272692:0:18691:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0e9c6870000 local copy 00010000:00010000:1.0:1788359496.272701:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359496.272782:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445376:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359496.272812:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.272973:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.273005:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445376 00000100:00100000:2.0:1788359496.273010:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445376 00000100:00100000:2.0:1788359496.273036:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788359496.273044:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:18691:x1875230445445376:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359496.273127:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:18691:x1875230445445376:12345-0@lo:501:mount.lustre.0 Request processed in 82us (313us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788359496.273134:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788359496.273212:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445376:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788359496.273223:0:18691:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788359496.273241:0:18691:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788359496.273247:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359496.273256:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788359496.273282:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eac6839000 10000000:01000000:1.0:1788359496.273287:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788359496.273292:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788359496.273294:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788359496.273298:0:18691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788359496.273301:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788359496.273321:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359496.273335:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359496.273344:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359496.273357:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788359496.273383:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.273405:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.273523:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445504 00000100:00100000:2.0:1788359496.273528:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445504 00000100:00100000:2.0:1788359496.273547:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788359496.273553:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+18:18691:x1875230445445504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359496.273561:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359496.273572:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feaf7e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf7d9 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.273603:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feaf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf7d9 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.273614:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75ea000/0x49dd053b5feaf7e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7d9 expref: 19 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.273623:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea000, rc 0) 00000100:00100000:2.0:1788359496.273654:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445504:12345-0@lo:101:mount.lustre.0 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.273666:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788359496.273806:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359496.273818:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7e0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359496.273827:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf7e0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359496.274941:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788359496.275647:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359496.277398:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788359496.277446:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788359496.277463:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788359496.277476:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788359496.277767:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788359496.277785:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788359496.277808:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788359496.277813:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788359496.277913:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359496.277977:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.278067:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202000 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.278116:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445632 00000100:00100000:2.0:1788359496.278125:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445632 00000100:00100000:2.0:1788359496.278202:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788359496.278212:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359496.278361:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445632:12345-0@lo:501:mount.lustre.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.278370:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788359496.278441:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359496.278476:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359496.278545:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.278767:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359496.278844:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445760 00000100:00100000:0.0:1788359496.278848:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445760 00000100:00100000:0.0:1788359496.278871:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788359496.278877:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359496.279458:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445760:12345-0@lo:503:mount.lustre.0 Request processed in 579us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.279466:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788359496.279647:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445760:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788359496.280042:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359496.280147:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445888:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359496.280186:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.280217:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.280330:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445445888 00000100:00100000:2.0:1788359496.280336:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445445888 00000100:00100000:2.0:1788359496.280362:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788359496.280370:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.280730:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445445888:12345-0@lo:502:mount.lustre.0 Request processed in 359us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.280738:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788359496.280835:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445445888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359496.281010:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788359496.281038:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788359496.281054:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788359496.281068:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788359496.281081:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788359496.281108:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788359496.281124:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788359496.281139:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788359496.281152:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788359496.281164:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788359496.281177:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788359496.281191:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788359496.281223:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446016:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359496.281260:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.281279:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c687ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.281330:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446016 00000100:00100000:2.0:1788359496.281335:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446016 00000100:00100000:2.0:1788359496.281354:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788359496.281361:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445446016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.281436:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445446016:12345-0@lo:502:mount.lustre.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.281443:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788359496.281537:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446016:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359496.281571:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788359496.281580:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788359496.282268:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788359496.282276:0:18708:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788359496.282283:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.282286:0:18708:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788359496.282295:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788359496.282309:0:18708:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0eaf58d19c0) 00000020:00000080:1.0:1788359496.282331:0:18708:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788359496.282337:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788359496.282400:0:18708:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eac6839000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788359496.282408:0:18708:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788359496.282415:0:18708:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x49dd053b5feaf7ee 00010000:00010000:1.0:1788359496.286221:0:18708:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788359496.286849:0:18708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1788359496.288155:0:18708:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788359496.289742:0:18708:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788359496.289755:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359496.289762:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289764:0:18708:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788359496.289770:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788359496.289773:0:18708:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788359496.289774:0:18708:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788359496.289776:0:18708:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788359496.289777:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788359496.289780:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289781:0:18708:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788359496.289784:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359496.289787:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289788:0:18708:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788359496.289791:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788359496.289793:0:18708:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788359496.289795:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359496.289797:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289799:0:18708:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788359496.289802:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788359496.289804:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289805:0:18708:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788359496.289808:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788359496.289834:0:18708:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788359496.289838:0:18708:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788359496.289840:0:18708:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788359496.289844:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788359496.297736:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788359496.297787:0:18691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788359496.297811:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7e0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.297835:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac0031e00/0x49dd053b5feaf7d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7e0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359496.297853:0:18691:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eac6839000 from 1 10000000:01000000:2.0:1788359496.297856:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359496.297891:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.297899:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.297909:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359496.297935:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788359496.298001:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.298040:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446144 00000100:00100000:2.0:1788359496.298048:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446144 00000100:00100000:2.0:1788359496.298106:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788359496.298115:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:18691:x1875230445446144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359496.298128:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359496.298140:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf7f5 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.298161:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 20 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.298172:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 20 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.298187:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb600, rc 0) 00000100:00100000:2.0:1788359496.298219:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446144:12345-0@lo:101:mount.lustre.0 Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.298226:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788359496.298265:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.298286:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359496.298301:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.298309:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359496.299261:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788359496.299536:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359496.300155:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788359496.300183:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788359496.300203:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788359496.300210:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788359496.300274:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359496.300329:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.300406:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788359496.302099:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446272 00000100:00100000:0.0:1788359496.302111:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446272 00000100:00100000:0.0:1788359496.302201:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788359496.302210:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359496.302362:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446272:12345-0@lo:501:mount.lustre.0 Request processed in 153us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.302370:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788359496.302455:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359496.302537:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788359496.302583:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.303113:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.303193:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446400 00000100:00100000:2.0:1788359496.303198:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446400 00000100:00100000:2.0:1788359496.303221:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788359496.303227:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359496.303311:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446400:12345-0@lo:503:mount.lustre.0 Request processed in 82us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.303323:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788359496.303403:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788359496.303786:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788359496.303863:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359496.303901:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.303913:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94780 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.304019:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446528 00000100:00100000:2.0:1788359496.304024:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446528 00000100:00100000:2.0:1788359496.304043:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788359496.304049:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.304141:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446528:12345-0@lo:502:mount.lustre.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.304149:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788359496.304221:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359496.304391:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788359496.304413:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788359496.304424:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788359496.304434:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788359496.304445:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788359496.304455:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788359496.304466:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788359496.304475:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788359496.304485:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788359496.304525:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788359496.304544:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788359496.304563:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446656:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359496.304683:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.304743:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94780 going to sleep for 11 seconds 00000100:00100000:0.0:1788359496.304860:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446656 00000100:00100000:0.0:1788359496.304865:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446656 00000100:00100000:2.0:1788359496.304896:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788359496.304903:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.304968:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446656:12345-0@lo:502:mount.lustre.0 Request processed in 65us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.304974:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788359496.305043:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359496.305076:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788359496.305094:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788359496.305685:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359496.305693:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359496.305695:0:18712:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788359496.305701:0:18712:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eac6839000 00000020:00000080:3.0:1788359496.305704:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788359496.305710:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788359496.305712:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359496.305714:0:18712:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788359496.305716:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788359496.305723:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788359496.305725:0:18712:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788359496.305728:0:18712:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eac6839000 00000020:00000080:3.0:1788359496.305730:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788359496.305793:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359496.306689:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359496.306692:0:18712:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788359496.306698:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359496.306701:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359496.306703:0:18712:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359496.306707:0:18712:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eac6839000 00000020:00000080:2.0:1788359496.306709:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788359496.306738:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359496.306741:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359496.306743:0:18712:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788359496.306745:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359496.306747:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359496.306749:0:18712:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788359496.306752:0:18712:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eac6839000 00000020:00000080:2.0:1788359496.306754:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788359496.306788:0:18712:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359496.306792:0:18712:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359496.306793:0:18712:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788359496.306796:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788359496.306888:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788359496.306913:0:18691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359496.306930:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.306943:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359496.307012:0:18691:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788359496.307014:0:18691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eac6839000 10000000:01000000:2.0:1788359496.307017:0:18691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eac6839000 10000000:01000000:2.0:1788359496.307020:0:18691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788359496.307025:0:18691:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eac6839000 from 1 10000000:01000000:2.0:1788359496.307027:0:18691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359496.307057:0:18691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307064:0:18691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307074:0:18691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359496.307106:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788359496.307153:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.307186:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446784 00000100:00100000:2.0:1788359496.307192:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446784 00000100:00100000:2.0:1788359496.307224:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788359496.307231:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:18691:x1875230445446784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359496.307243:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359496.307253:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feaf80a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf803 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307273:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feaf80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf803 expref: 21 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307283:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0e9c75ea200/0x49dd053b5feaf80a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf803 expref: 21 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307292:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea200, rc 0) 00000100:00100000:2.0:1788359496.307318:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445446784:12345-0@lo:101:mount.lustre.0 Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359496.307324:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788359496.307360:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359496.307378:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359496.307390:0:18691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf80a expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.307399:0:18691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf80a expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359496.310357:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788359496.312851:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359496.313039:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788359496.313065:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788359496.313079:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788359496.313116:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788359496.313132:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788359496.313145:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788359496.313157:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788359496.313170:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788359496.313185:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788359496.313199:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788359496.313223:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788359496.313235:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788359496.313245:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788359496.313256:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788359496.313266:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788359496.313277:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788359496.313287:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788359496.313297:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788359496.313308:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788359496.313321:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788359496.313334:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788359496.313346:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788359496.313360:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788359496.313375:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788359496.313386:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788359496.313396:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788359496.313417:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788359496.313428:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788359496.313439:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788359496.313449:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788359496.313460:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788359496.313470:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788359496.313480:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788359496.313491:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788359496.313527:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788359496.313541:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788359496.313566:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788359496.314435:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788359496.314447:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788359496.314568:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359496.314646:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.314727:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.315685:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445446912 00000100:00100000:1.0:1788359496.315697:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445446912 00000100:00100000:1.0:1788359496.322327:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788359496.322348:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445446912:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359496.322553:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445446912:12345-0@lo:501:mount.lustre.0 Request processed in 213us (7906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.322562:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788359496.322711:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445446912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359496.322762:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359496.322807:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.322834:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.322882:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447040 00000100:00100000:1.0:1788359496.322888:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447040 00000100:00100000:1.0:1788359496.322913:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788359496.322919:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447040:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359496.322996:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447040:12345-0@lo:503:mount.lustre.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.323003:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788359496.323072:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788359496.323459:0:18691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788359496.323552:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.323652:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.323671:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.323743:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447168 00000100:00100000:1.0:1788359496.323747:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447168 00000100:00100000:1.0:1788359496.323767:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788359496.323772:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359496.323841:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447168:12345-0@lo:502:mount.lustre.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.323848:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788359496.323927:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788359496.324101:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788359496.324128:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788359496.324143:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788359496.324156:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788359496.324169:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788359496.324182:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788359496.324195:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788359496.324209:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788359496.324221:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788359496.324233:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788359496.324245:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788359496.324268:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788359496.324282:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788359496.324296:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788359496.324308:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788359496.324334:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788359496.324350:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788359496.324363:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788359496.324377:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788359496.324390:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788359496.324403:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788359496.324414:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788359496.324426:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788359496.324439:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788359496.324451:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788359496.324464:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788359496.324476:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788359496.324488:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788359496.324551:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788359496.324567:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788359496.324580:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788359496.324674:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788359496.324690:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788359496.324702:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788359496.324713:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788359496.324726:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788359496.324740:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788359496.324753:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788359496.324766:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788359496.324778:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788359496.324791:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788359496.324803:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788359496.324816:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788359496.324829:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788359496.324852:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788359496.324865:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788359496.324876:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788359496.324895:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788359496.324929:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359496.324971:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359496.324998:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.325376:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447296 00000100:00100000:1.0:1788359496.325383:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447296 00000100:00100000:1.0:1788359496.325410:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788359496.325417:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359496.325522:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447296:12345-0@lo:502:mount.lustre.0 Request processed in 104us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.325530:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788359496.325550:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359496.325691:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788359496.325727:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788359496.325863:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447424:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359496.325900:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.325926:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94900 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.326252:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447424 00000100:00100000:1.0:1788359496.326257:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447424 00000100:00100000:1.0:1788359496.326281:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788359496.326286:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359496.326355:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445447424:12345-0@lo:502:mount.lustre.0 Request processed in 68us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.326362:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788359496.326386:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445447424:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359496.326423:0:18691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788359496.326430:0:18691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788359496.329232:0:18717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788359496.329250:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0eaf58d0000) 00000020:00000080:1.0:1788359496.329273:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788359496.329429:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eac6839000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359496.329434:0:18717:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eac6839000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788359496.329436:0:18717:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eac6839000 3 00010000:00080000:1.0:1788359496.329472:0:18717:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c6920000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.152@tcp at head 00010000:00010000:1.0:1788359496.333749:0:18717:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788359496.333862:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788359496.333896:0:18717:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788359496.333905:0:18717:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x49dd053b5feaf818 00000100:00080000:1.0:1788359496.333914:0:18717:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788359496.333918:0:18717:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0e9c6920000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359496.333949:0:18717:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80ef800 x1875230445447552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359496.333982:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445447552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788359496.334043:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788359496.334105:0:18717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788359496.334207:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447552 00000100:00100000:0.0:1788359496.334215:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447552 00000100:00080000:3.0:1788359496.334230:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.334235:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788359496.334237:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.334240:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788359496.334244:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359496.334251:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3641:x1875230445447552:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788359496.334261:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.334264:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788359496.334267:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.334270:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788359496.334272:0:17190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1788359496.334299:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x49dd053b5feaf81f 00000004:00100000:0.0:1788359496.334314:0:17190:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788359496.334342:0:17190:0:(import.c:65:import_set_state_nolock()) ffffa0eaec386800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359496.334393:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875230445447552:12345-0@lo:38:llog_process_th.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.334400:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788359496.334425:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445447808:0@lo:400:kworker.0 00000100:00100000:3.0:1788359496.334446:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445447936:0@lo:400:kworker.0 00000100:00100000:0.0:1788359496.334450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.334471:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788359496.334476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.334483:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788359496.334518:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788359496.334522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.334523:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445448064:0@lo:400:kworker.0 00000100:00100000:3.0:1788359496.334544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.334551:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447808 00000100:00100000:0.0:1788359496.334555:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447808 00000100:00100000:3.0:1788359496.334570:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447936 00000100:00100000:3.0:1788359496.334574:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447936 00000100:00100000:0.0:1788359496.334577:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448064 00000100:00100000:0.0:1788359496.334579:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448064 00000100:00100000:3.0:1788359496.334593:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445447680 00000100:00100000:3.0:1788359496.334596:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445447680 00000100:00100000:3.0:1788359496.334610:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788359496.334616:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445447936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359496.334654:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445447936:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359496.334661:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788359496.334674:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788359496.334680:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445447680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359496.334709:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445447680:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359496.334727:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788359496.334872:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445447936:0@lo:400:kworker.0 00000020:01000004:3.0:1788359496.334971:0:18717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788359496.334993:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffffa0e9c5638000) 00000020:00000080:3.0:1788359496.335010:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788359496.335172:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eac6839000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788359496.335177:0:18717:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eac6839000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788359496.335179:0:18717:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eac6839000 3 00010000:00080000:3.0:1788359496.335203:0:18717:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0eaf6f68000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.152@tcp at head 00000100:00100000:0.0:1788359496.335900:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359496.335910:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445447808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359496.335961:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445447808:12345-0@lo:400:kworker.0 Request processed in 53us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.335968:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359496.335981:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359496.335986:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445448064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359496.337706:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445448064:12345-0@lo:400:kworker.0 Request processed in 1715us (3156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.337718:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788359496.338147:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0e9c80ef800 x1875230445447552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359496.338160:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359496.338169:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788359496.338177:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788359496.338181:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788359496.338184:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6920000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788359496.338190:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3641:1875230445447552:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788359496.338227:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445447680:0@lo:400:kworker.0 00010000:00080000:0.0:1788359496.338239:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ead27b8380 x1875230445447808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359496.338255:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445447808:0@lo:400:kworker.0 00010000:00010000:3.0:1788359496.338799:0:18717:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788359496.338905:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788359496.338947:0:18717:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788359496.338963:0:18717:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x49dd053b5feaf82d 00000100:00080000:3.0:1788359496.338970:0:18717:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359496.338975:0:18717:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffffa0eaf6f68000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359496.339002:0:18717:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9500 x1875230445448192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788359496.339019:0:18717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788359496.339030:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445448192:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788359496.339038:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.339042:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788359496.339044:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.339047:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788359496.339051:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.339066:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788359496.339068:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359496.339071:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788359496.339078:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.339130:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448192 00000100:00100000:0.0:1788359496.339137:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448192 00000100:00100000:0.0:1788359496.339160:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788359496.339165:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445448192:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788359496.339186:0:17189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1788359496.339212:0:17189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x49dd053b5feaf834 00000004:00100000:0.0:1788359496.339226:0:17189:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788359496.339253:0:17189:0:(import.c:65:import_set_state_nolock()) ffffa0eaec385800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359496.339296:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875230445448192:12345-0@lo:38:llog_process_th.0 Request processed in 128us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.339302:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788359496.339331:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ead27b9500 x1875230445448192/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359496.339340:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788359496.339345:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788359496.339350:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788359496.339352:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788359496.339355:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf6f68000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788359496.339359:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3641:1875230445448192:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788359496.339761:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0ead27b9c00 x1875230445448064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359496.339773:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445448064:0@lo:400:kworker.0 00000040:00080000:2.0:1788359496.339939:0:18717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788359496.340001:0:18691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788359496.340032:0:18691:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788359496.340170:0:18691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf80a expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.340180:0:18691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb800/0x49dd053b5feaf803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf80a expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788359496.340216:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788359496.340218:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788359496.340219:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359496.340219:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359496.340222:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359496.340223:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359496.340224:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788359496.340225:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359496.340226:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788359496.340230:0:18691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788359496.340231:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788359496.340232:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788359496.340233:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788359496.340233:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788359496.340234:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788359496.340235:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788359496.340235:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788359496.340236:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788359496.340236:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788359496.340248:0:18691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788359496.340259:0:18691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445448320:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788359496.340296:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359496.340367:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448320 00000100:00100000:1.0:1788359496.340372:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448320 00000100:00100000:3.0:1788359496.340385:0:18691:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.340441:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788359496.340449:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445448320:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788359496.340468:0:17182:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788359496.340481:0:17182:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788359496.345198:0:17182:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788359496.345218:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788359496.345489:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:18691:x1875230445448320:12345-0@lo:253:mount.lustre.0 Request processed in 5036us (5186us total) trans 0 rc 0/0 20000000:01000000:3.0:1788359496.345551:0:17205:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:0.0:1788359496.345554:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 10000000:01000000:3.0:1788359496.345556:0:17205:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788359496.345577:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345592:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345601:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345610:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345655:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345700:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359496.345711:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445448448:0@lo:104: 00000100:00100000:3.0:1788359496.345753:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788359496.345814:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 20 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359496.345821:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 20 pid: 17184 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359496.345830:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445448576:0@lo:104: 00000100:00100000:3.0:1788359496.345853:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359496.345876:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57e2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788359496.345913:0:17173:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788359496.345929:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448448 00000100:00100000:1.0:1788359496.345936:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448448 00000100:00100000:1.0:1788359496.345964:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448576 00000100:00100000:1.0:1788359496.345967:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448576 00000100:00100000:1.0:1788359496.345981:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359496.345989:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+4:17205:x1875230445448448:12345-0@lo:104: 00010000:00010000:1.0:1788359496.346003:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359496.346060:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788359496.346066:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+4:17205:x1875230445448448:12345-0@lo:104: Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359496.346073:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359496.346097:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359496.346106:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445448576:12345-0@lo:104: 00010000:00010000:1.0:1788359496.346115:0:17173:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359496.346134:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445448448:0@lo:104: 00010000:00010000:1.0:1788359496.346149:0:17173:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788359496.346150:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445448576:0@lo:104: 00000100:00100000:1.0:1788359496.346157:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445448576:12345-0@lo:104: Request processed in 53us (302us total) trans 0 rc 0/0 00010000:00010000:3.0:1788359496.346170:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359496.346175:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359496.346283:0:18691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:18691:1875230445448320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788359496.346293:0:18691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788359496.346296:0:18691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788359496.346298:0:18691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788359496.346299:0:18691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359496.346301:0:18691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359496.346363:0:18691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359496.346365:0:18691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359496.346366:0:18691:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359496.346369:0:18691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359496.346370:0:18691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788359496.346382:0:18691:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1788359496.347439:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359496.347448:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347456:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359496.347459:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347466:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359496.347471:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359496.347475:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359496.347524:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347530:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359496.347557:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347565:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6200/0x49dd053b5feaf78c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf793 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359496.347574:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445448704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359496.347579:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359496.347583:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347600:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359496.347604:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347612:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359496.347618:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359496.347623:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359496.347651:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347659:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359496.347668:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347675:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eba00/0x49dd053b5feaf77e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf785 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347692:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359496.347694:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359496.347696:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359496.347705:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359496.347718:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445448832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788359496.347776:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.347840:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448832 00000100:00100000:0.0:1788359496.347847:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448832 00010000:00010000:0.0:1788359496.347880:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 21 pid: 17184 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359496.347910:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359496.347920:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:3645:x1875230445448832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359496.347934:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359496.347940:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 21 pid: 17184 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347952:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 21 pid: 17184 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347966:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad6000/0x49dd053b5feaf785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf77e expref: 21 pid: 17184 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.347978:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788359496.348016:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:3645:x1875230445448832:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.348080:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788359496.348128:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445448832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359496.348184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359496.348393:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448704 00000100:00100000:0.0:1788359496.348398:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448704 00010000:00010000:0.0:1788359496.348416:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359496.348451:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359496.348457:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff038c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+20:3644:x1875230445448704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359496.348464:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359496.348469:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348485:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348514:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7400/0x49dd053b5feaf793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf78c expref: 20 pid: 17183 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348527:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348535:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788359496.348549:0:17174:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003752711s 00010000:00010000:0.0:1788359496.348553:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348560:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348567:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348573:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348579:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359496.348582:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1788359496.348585:0:18691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1788359496.348594:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348624:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359496.348635:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359496.348639:0:17205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.348646:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359496.348653:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaffad7600/0x49dd053b5feaf83b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359496.348667:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff038c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3644:x1875230445448704:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359496.348674:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359496.348736:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445448704:0@lo:103:ldlm_bl.0 00002000:00080000:0.0:1788359496.350275:0:18691:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788359496.350281:0:18691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788359496.350314:0:18691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788359496.350364:0:18691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788359496.350385:0:18691:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788359496.350409:0:18691:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788359496.351178:0:18691:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359496.351379:0:18691:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359496.572649:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788359496.977285:0:18771:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359496.977802:0:18771:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788359497.341305:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359487/real 1788359487] req@ffffa0ead27bb800 x1875230445438336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.341346:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27bb800 x1875230445438336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.341359:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359487/real 1788359487] req@ffffa0ead27b9180 x1875230445438208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359497 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.341372:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0ead27b9180 x1875230445438208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359497 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788359497.341408:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788359497.341508:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788359497.341514:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445438336:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788359497.341521:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788359497.347443:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445448960:0@lo:400:kworker.0 00000100:00100000:3.0:1788359497.347574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788359497.350265:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788359497.350279:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445438208:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788359497.350351:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445448960 00000100:00100000:0.0:1788359497.350361:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445448960 00000100:00100000:0.0:1788359497.350429:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788359497.350439:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3642:x1875230445448960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359497.351918:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445449088:0@lo:400:kworker.0 00000100:00100000:1.0:1788359497.351999:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359497.352112:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449088 00000100:00100000:1.0:1788359497.352120:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449088 00000100:00100000:1.0:1788359497.352173:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788359497.352184:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445449088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359497.352245:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445449088:12345-0@lo:400:kworker.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359497.352253:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788359497.352311:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445449088:0@lo:400:kworker.0 00000100:00080000:2.0:1788359497.352919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.352938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359497.352942:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.352945:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788359497.353005:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445449216:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.353056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.353127:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449216 00000100:00100000:2.0:1788359497.353133:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449216 00000100:00100000:2.0:1788359497.353173:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788359497.353182:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445449216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.353228:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445449216:12345-0@lo:400:kworker.0 Request processed in 47us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.353236:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788359497.353273:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28de680 x1875230445449216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359497.353287:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445449216:0@lo:400:kworker.0 00000100:00080000:2.0:1788359497.353316:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.353320:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788359497.353324:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359497.353330:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788359497.353335:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359497.353341:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffffa0eaf95cd800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359497.353350:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445449344:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.353377:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.353415:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449344 00000100:00100000:2.0:1788359497.353419:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449344 00000100:00100000:2.0:1788359497.353438:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788359497.353444:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445449344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.353480:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445449344:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.353486:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788359497.353541:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445449344:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.353575:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28de680 x1875230445449472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359497.353605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.353609:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788359497.353611:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359497.355129:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788359497.355138:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788359497.355146:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359497.355180:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead28ded80 x1875230445449600/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359497.355233:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788359497.355251:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445449728:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.355318:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.355374:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449728 00000100:00100000:2.0:1788359497.355381:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449728 00000100:00100000:2.0:1788359497.355431:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359497.355441:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445449728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.355512:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445449728:12345-0@lo:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.355531:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788359497.355589:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28df100 x1875230445449728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359497.355603:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445449728:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.355826:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445449856:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.355861:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.355891:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449856 00000100:00100000:2.0:1788359497.355895:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449856 00000100:00100000:2.0:1788359497.355934:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359497.355940:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445449856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.355968:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445449856:12345-0@lo:400:kworker.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.355972:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788359497.355991:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28df100 x1875230445449856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359497.355998:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445449856:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.356021:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445449984:0@lo:400:kworker.0 00000100:00100000:2.0:1788359497.356042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.356060:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449984 00000100:00100000:2.0:1788359497.356062:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449984 00000100:00100000:2.0:1788359497.356092:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359497.356098:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445449984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359497.356168:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+19:3642:x1875230445448960:12345-0@lo:400:kworker.0 Request processed in 5728us (8593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359497.356179:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788359497.356191:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445449984:12345-0@lo:400:kworker.0 Request processed in 94us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.356210:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788359497.356235:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28df100 x1875230445449984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788359497.356235:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788359497.356240:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359497.356244:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445449984:0@lo:400:kworker.0 00000100:00100000:0.0:1788359497.356254:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445449472:0@lo:8:kworker.0 00000100:00080000:2.0:1788359497.356265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.356270:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359497.356273:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359497.356276:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788359497.356285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359497.356320:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445449600:0@lo:8:kworker.0 00000100:00100000:0.0:1788359497.356343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359497.356477:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449472 00000100:00100000:2.0:1788359497.356481:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449472 00000100:00100000:2.0:1788359497.356512:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445449600 00000100:00100000:2.0:1788359497.356515:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445449600 00000100:00100000:2.0:1788359497.356526:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359497.356531:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445449472:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788359497.356560:0:18695:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:2.0:1788359497.356603:0:18695:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feaf842 00002000:00100000:2.0:1788359497.356695:0:18695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffffa0e9c14e1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788359497.356701:0:18695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788359497.356704:0:18695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788359497.356911:0:18695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788359497.356942:0:18695:0:(import.c:65:import_set_state_nolock()) ffffa0e9c14e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359497.356991:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445449472:12345-0@lo:8:kworker.0 Request processed in 458us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359497.356999:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359497.357017:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788359497.357022:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445449600:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788359497.357034:0:18695:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788359497.358007:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28de680 x1875230445449472/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359497.358021:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359497.358033:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788359497.358043:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788359497.358050:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788359497.358054:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95cd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788359497.358094:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788359497.358100:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445449472:0@lo:8:kworker.0 00000004:00080000:0.0:1788359497.358110:0:17930:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788359497.358211:0:17930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 529328715037ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788359497.358218:0:17930:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788359497.358549:0:17931:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788359497.358724:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450240:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788359497.358788:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359497.358819:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff202d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359497.358849:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788359497.358857:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788359497.359389:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450240 00000100:00100000:1.0:1788359497.359404:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450240 00000100:00080000:0.0:1788359497.359445:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788359497.360153:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445448960:0@lo:400:kworker.0 00000100:00100000:3.0:1788359497.360232:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445450112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788359497.360298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359497.360308:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359497.360321:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17931:x1875230445450240:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788359497.360350:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450112 00000100:00100000:1.0:1788359497.360354:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450112 00000100:00100000:1.0:1788359497.360381:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359497.360386:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875230445450112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359497.360409:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788359497.360467:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875230445450112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359497.360474:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788359497.360578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c80ed880 x1875230445450112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359497.360598:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445450112:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788359497.364306:0:17921:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788359497.373161:0:18793:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788359497.373171:0:18793:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00010000:00080000:0.0:1788359497.373285:0:17931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c80efb80 x1875230445450240/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359513 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.373317:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450240:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788359497.373332:0:17931:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788359497.373385:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450368:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788359497.373430:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359497.373465:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead21f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359497.373524:0:18696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788359497.373533:0:18696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788359497.373609:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17931:x1875230445450240:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12945us (14473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359497.373620:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788359497.373651:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450368 00000100:00100000:1.0:1788359497.373658:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450368 00000100:00100000:1.0:1788359497.373707:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359497.373717:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17931:x1875230445450368:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788359497.373743:0:18697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788359497.373784:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17931:x1875230445450368:12345-0@lo:5:osp-pre-0-1.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359497.373790:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788359497.373799:0:17931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c8127b80 x1875230445450368/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359513 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.373810:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450368:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788359497.373822:0:17931:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788359497.373850:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450496:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788359497.373868:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359497.373890:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead21f79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359497.373902:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450496 00000100:00100000:1.0:1788359497.373914:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450496 00000100:00100000:1.0:1788359497.373947:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359497.373955:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17931:x1875230445450496:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788359497.373979:0:18696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788359497.380573:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445449600:12345-0@lo:8:kworker.0 Request processed in 23542us (24222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788359497.380588:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788359497.380680:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359497.380687:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359497.380693:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445449600:0@lo:8:kworker.0 00000001:00080000:0.0:1788359497.389968:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788359497.389982:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788359497.390258:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17931:x1875230445450496:12345-0@lo:5:osp-pre-0-1.0 Request processed in 16300us (16383us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788359497.390311:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788359497.390551:0:17931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c8127b80 x1875230445450496/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359513 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359497.390563:0:17931:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788359497.390571:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17931:1875230445450496:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788359497.390590:0:17931:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788359497.390664:0:17931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17931:1875230445450624:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788359497.390707:0:17931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359497.390756:0:17931:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead21f79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359497.391151:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450624 00000100:00100000:1.0:1788359497.391159:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450624 00000100:00100000:1.0:1788359497.391207:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359497.391215:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17931:x1875230445450624:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788359497.391274:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17931:x1875230445450624:12345-0@lo:900:osp-pre-0-1.0 Request processed in 60us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359497.391281:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788359497.391387:0:17931:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0eaffb65f80 x1875230445450624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788359513 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359497.391408:0:17931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17931:1875230445450624:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1788359497.597178:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359497.928190:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445450752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359497.928273:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359497.928334:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450752 00000100:00100000:3.0:1788359497.928341:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450752 00000100:00100000:3.0:1788359497.928378:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359497.928385:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445450752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359497.928417:0:17929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788359497.928457:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445450752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359497.928463:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359497.928532:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445450752:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788359498.236577:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788359498.236585:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaffa8a000 from 9 10000000:01000000:0.0:1788359498.236590:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788359498.236642:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359498.236655:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359498.236666:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359498.236704:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445450880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359498.236772:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359498.236816:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359498.236902:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445450880 00000100:00100000:1.0:1788359498.236910:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445450880 00000100:00100000:1.0:1788359498.236953:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788359498.236962:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+19:17186:x1875230445450880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359498.236974:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359498.236987:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf849 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359498.237007:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 20 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359498.237033:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 20 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359498.237042:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac0031c00, rc 0) 00000100:00100000:1.0:1788359498.237184:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+20:17186:x1875230445450880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359498.237191:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788359498.237303:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445450880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359498.237317:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.237325:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359498.237372:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788359498.237406:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359498.237469:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359498.237625:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451008 00000100:00100000:0.0:1788359498.237629:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451008 00000100:00100000:1.0:1788359498.237905:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788359498.237913:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:17186:x1875230445451008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788359498.237928:0:17183:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788359498.237945:0:17183:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788359498.237947:0:17183:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788359498.238032:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:17186:x1875230445451008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359498.238040:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788359498.238105:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788359498.238165:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359498.238172:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.238181:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359498.238191:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788359498.238193:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0ead20a0000 from 9 10000000:01000000:2.0:1788359498.238195:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788359498.238220:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.238228:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.238235:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359498.238249:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359498.238275:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359498.238623:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359498.238779:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451136 00000100:00100000:0.0:1788359498.238785:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451136 00000100:00100000:0.0:1788359498.238813:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788359498.238820:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+20:17186:x1875230445451136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788359498.238830:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359498.238842:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf857 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359498.238859:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359498.238869:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 21 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359498.238886:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8800, rc 0) 00000100:00100000:0.0:1788359498.238930:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445451136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359498.238935:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788359498.239013:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359498.239026:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.239034:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359498.239087:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788359498.239118:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359498.239139:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359498.239191:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451264 00000100:00100000:0.0:1788359498.239195:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451264 00000100:00100000:0.0:1788359498.239213:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788359498.239218:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445451264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788359498.239229:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788359498.239242:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788359498.239245:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788359498.239323:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445451264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359498.239330:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788359498.239396:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445451264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788359498.239439:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788359498.239445:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359498.239530:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359498.620696:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359499.645093:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359499.964654:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445451392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359499.964725:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359499.964790:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451392 00000100:00100000:2.0:1788359499.964797:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451392 00000100:00100000:2.0:1788359499.964841:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359499.964862:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445451392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788359499.964896:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788359499.964938:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445451392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359499.964945:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359499.965003:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445451392:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788359499.967795:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788359500.264037:0:19062:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788359500.672289:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788359500.926441:0:19114:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359500.926903:0:19114:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1788359501.544443:0:19164:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359501.544882:0:19164:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788359501.692888:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788359502.013452:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788359502.524614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359502.524621:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359502.524624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359502.524627:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788359502.524654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359502.524657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788359502.524660:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359502.524668:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 529 00000100:00080000:2.0:1788359502.524673:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788359502.524685:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359502.524707:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74fea00 x1875230445452160/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359502.524752:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445451776:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.524818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.524874:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445452416:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.524901:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.524930:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788359502.524936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445451904:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.524960:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.524977:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445452544:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.524998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.525041:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445452160:0@lo:8:kworker.0 00000100:00100000:1.0:1788359502.525057:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445451648:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359502.525085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.525106:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451776 00000100:00100000:1.0:1788359502.525108:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445452288:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525113:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451776 00000100:00100000:1.0:1788359502.525125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359502.525142:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788359502.525147:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452416 00000100:00100000:1.0:1788359502.525147:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445451520:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525149:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452416 00000100:00100000:2.0:1788359502.525173:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452544 00000100:00100000:2.0:1788359502.525175:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452544 00000100:00100000:1.0:1788359502.525175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.525186:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452288 00000100:00100000:2.0:1788359502.525188:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452288 00000100:00100000:2.0:1788359502.525202:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359502.525202:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452032:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525209:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445451776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359502.525220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359502.525242:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452160 00000100:00100000:1.0:1788359502.525245:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452160 00000100:00100000:2.0:1788359502.525251:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445451776:12345-0@lo:400:kworker.0 Request processed in 43us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.525258:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788359502.525262:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452032 00000100:00100000:1.0:1788359502.525264:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452032 00000100:00100000:2.0:1788359502.525277:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359502.525282:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359502.525285:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788359502.525291:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525309:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445452416:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.525315:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359502.525316:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452032:12345-0@lo:400:kworker.0 Request processed in 27us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359502.525322:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788359502.525325:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359502.525331:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445452544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359502.525331:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359502.525335:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1875230445452160:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788359502.525352:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445452544:12345-0@lo:400:kworker.0 Request processed in 22us (353us total) trans 0 rc 0/0 00010000:00020000:1.0:1788359502.525352:0:18793:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788359502.525358:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359502.525368:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788359502.525372:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445452288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525395:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875230445452288:12345-0@lo:400:kworker.0 Request processed in 23us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.525400:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788359502.525419:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451904 00000100:00100000:2.0:1788359502.525422:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451904 00000100:00100000:2.0:1788359502.525442:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451648 00000100:00100000:2.0:1788359502.525444:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451648 00000100:00100000:2.0:1788359502.525454:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359502.525460:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445451904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525490:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445451904:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.525519:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359502.525533:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359502.525539:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445451648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525575:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445451648:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.525581:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788359502.525607:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359502.525611:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359502.525613:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788359502.525648:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445451904:0@lo:400:kworker.0 00010000:00080000:2.0:1788359502.525661:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c74fd180 x1875230445452544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.525671:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445452544:0@lo:400:kworker.0 00010000:00080000:2.0:1788359502.525681:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28ded80 x1875230445451776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.525690:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445451776:0@lo:400:kworker.0 00010000:00080000:2.0:1788359502.525699:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c74fca80 x1875230445452416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.525707:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445452416:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.525984:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445451520 00000100:00100000:2.0:1788359502.525988:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445451520 00000100:00100000:2.0:1788359502.526020:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788359502.526040:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:3645:x1875230445451520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.526074:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:3645:x1875230445451520:12345-0@lo:400:kworker.0 Request processed in 47us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.526082:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788359502.526131:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:caaeac2e-9afd-44da-91ff-e628fee28e20:3645:1875230445451520:0@lo:400:kworker.0 00010000:00080000:2.0:1788359502.526156:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead28de680 x1875230445452032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.526166:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452032:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.526178:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445451648:0@lo:400:kworker.0 00010000:00080000:2.0:1788359502.526188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c74ffb80 x1875230445452288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.526196:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875230445452288:0@lo:400:kworker.0 00000100:00100000:2.0:1788359502.526212:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359502.526219:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788359502.526247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359502.526285:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452672 00000100:00100000:2.0:1788359502.526288:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452672 00000100:00100000:2.0:1788359502.526318:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788359502.526326:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359502.526346:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788359502.526383:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359502.526390:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788359502.526414:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead27bbb80 x1875230445452672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359502.526430:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359502.534426:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3641:x1875230445452160:12345-0@lo:8:kworker.0 Request processed in 9079us (9346us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359502.534441:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788359502.534453:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788359502.534460:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788359502.534474:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445452160:0@lo:8:kworker.0 00010000:00010000:2.0:1788359502.716623:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359503.037799:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788359503.037867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359503.038031:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452800 00000100:00100000:1.0:1788359503.038039:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452800 00000100:00100000:1.0:1788359503.038090:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359503.038099:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359503.038132:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788359503.038188:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445452800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359503.038195:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788359503.038272:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445452800:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788359503.740830:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359504.572792:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359489/real 1788359489] req@ffffa0e9c8126680 x1875230445442048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359504 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359504.572824:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0e9c8126680 x1875230445442048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359504 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359504.572843:0:3641:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788359489/real 1788359489] req@ffffa0e9c8127100 x1875230445442176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359504 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359504.572856:0:3641:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0e9c8127100 x1875230445442176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788359504 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788359504.572873:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb006a7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788359504.577125:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788359504.577138:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445442048:0@lo:8:kworker.0 00000100:00080000:3.0:1788359504.577151:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788359504.577159:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788359504.577163:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445442176:0@lo:8:kworker.0 00000100:00080000:1.0:1788359504.577325:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788359504.577343:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788359504.577345:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eb006a7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788359504.577350:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1788359504.577354:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788359504.577361:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0eb006a7000 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359504.577381:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80ece00 x1875230445453184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359504.577397:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788359504.577399:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788359504.577401:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788359504.577403:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1788359504.577406:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788359504.577408:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0eb0068a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359504.577420:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c80ee300 x1875230445453312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788359504.577456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788359504.577460:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788359504.577461:0:38:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788359504.577464:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 534 00000100:00080000:1.0:1788359504.577467:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788359504.577470:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:1.0:1788359504.577480:0:38:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead2753b80 x1875230445453824/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359504.577554:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445453440:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.577621:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.577653:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445454080:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.577674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.577694:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788359504.577700:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445453568:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.577723:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.577741:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445454208:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.577766:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.577790:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445453184:0@lo:8:kworker.0 00000100:00100000:1.0:1788359504.577813:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.577835:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453184 00000100:00100000:1.0:1788359504.577842:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453184 00000100:00100000:1.0:1788359504.577874:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788359504.577881:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445453184:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788359504.577910:0:18696:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788359504.577939:0:18696:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feaf865 00002000:00100000:1.0:1788359504.577954:0:18696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0e9c6926800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788359504.577958:0:18696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788359504.577960:0:18696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788359504.578050:0:18696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788359504.578070:0:18696:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6923800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359504.578107:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445453184:12345-0@lo:8:kworker.0 Request processed in 225us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359504.578113:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788359504.578157:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c80ece00 x1875230445453184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359504.578178:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359504.578184:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788359504.578190:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788359504.578194:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788359504.578196:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb006a7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788359504.578208:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788359504.578211:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445453184:0@lo:8:kworker.0 00000004:00080000:1.0:1788359504.578233:0:17214:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788359504.578247:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17214:1875230445454464:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788359504.578267:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.578280:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82fa80 going to sleep for 11 seconds 00000004:00080000:1.0:1788359504.578292:0:17213:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788359504.578346:0:17213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 536548850856ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788359504.578353:0:17213:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788359504.578514:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445453312:0@lo:8:kworker.0 00000100:00100000:1.0:1788359504.578538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.578560:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445453824:0@lo:8:kworker.0 00000100:00100000:1.0:1788359504.578593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.578613:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454464 00000100:00100000:1.0:1788359504.578618:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454464 00000100:00100000:1.0:1788359504.578647:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453312 00000100:00100000:1.0:1788359504.578649:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453312 00000100:00100000:1.0:1788359504.578658:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453824 00000100:00100000:1.0:1788359504.578660:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453824 00000100:00100000:1.0:1788359504.578668:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788359504.578674:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17214:x1875230445454464:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788359504.578858:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359504.578863:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445453312:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788359504.578876:0:18696:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788359504.578906:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445453312:12345-0@lo:8:kworker.0 Request processed in 42us (367us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359504.578912:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788359504.578924:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788359504.578928:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445453824:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788359504.578936:0:18696:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788359504.578959:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445453824:12345-0@lo:8:kworker.0 Request processed in 29us (365us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788359504.578965:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788359504.578987:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359504.578991:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359504.578994:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2753b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445453824:0@lo:8:kworker.0 00000100:00080000:1.0:1788359504.579046:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359504.579050:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788359504.579053:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445453312:0@lo:8:kworker.0 00000100:00100000:3.0:1788359504.579087:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445452928:0@lo:400:kworker.0 00000100:00100000:3.0:1788359504.579120:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359504.579151:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445453696:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579168:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445452928 00000100:00100000:3.0:1788359504.579174:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.579174:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445452928 00000100:00100000:3.0:1788359504.579196:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445454336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788359504.579216:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788359504.579225:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359504.579229:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445453056:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579229:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:3642:x1875230445452928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579266:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359504.579294:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445453952:0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579295:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:3642:x1875230445452928:12345-0@lo:400:kworker.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359504.579317:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788359504.579324:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359504.579358:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453440 00000100:00100000:2.0:1788359504.579362:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453440 00000100:00100000:1.0:1788359504.579378:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445452928:0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579385:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454080 00000100:00100000:2.0:1788359504.579389:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454080 00000100:00100000:2.0:1788359504.579402:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454208 00000100:00100000:2.0:1788359504.579404:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454208 00000100:00100000:2.0:1788359504.579414:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453952 00000100:00100000:2.0:1788359504.579416:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453952 00000100:00100000:2.0:1788359504.579426:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788359504.579432:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445453440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579468:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445453440:12345-0@lo:400:kworker.0 Request processed in 35us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.579473:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788359504.579484:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359504.579489:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445454080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579532:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445454080:12345-0@lo:400:kworker.0 Request processed in 42us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.579537:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788359504.579548:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359504.579560:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445454208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579588:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445454208:12345-0@lo:400:kworker.0 Request processed in 29us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.579594:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359504.579606:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359504.579613:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445453952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579641:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453696 00000100:00100000:2.0:1788359504.579647:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445453952:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359504.579647:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453696 00000100:00100000:2.0:1788359504.579656:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788359504.579679:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453568 00000100:00100000:2.0:1788359504.579683:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453568 00000100:00100000:1.0:1788359504.579697:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788359504.579707:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445453696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579711:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445453056 00000100:00100000:2.0:1788359504.579715:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445453056 00000100:00100000:2.0:1788359504.579731:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359504.579738:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445453568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579756:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445453696:12345-0@lo:400:kworker.0 Request processed in 50us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359504.579765:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788359504.579777:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445453568:12345-0@lo:400:kworker.0 Request processed in 38us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.579784:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788359504.579800:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788359504.579807:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c80efb80 x1875230445453696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.579809:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445453056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359504.579826:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445453696:0@lo:400:kworker.0 00000100:00100000:2.0:1788359504.579849:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445453056:12345-0@lo:400:kworker.0 Request processed in 42us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.579855:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788359504.579885:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359504.579888:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359504.579891:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359504.579903:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454336 00000100:00100000:2.0:1788359504.579912:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454336 00000100:00100000:2.0:1788359504.579949:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359504.579956:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445454336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359504.579975:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788359504.580025:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875230445454336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.580032:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788359504.580066:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445453056:0@lo:400:kworker.0 00010000:00080000:2.0:1788359504.580077:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2750e00 x1875230445453952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.580087:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2750e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445453952:0@lo:400:kworker.0 00010000:00080000:2.0:1788359504.580139:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2752d80 x1875230445454336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.580154:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2752d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445454336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788359504.580180:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445453568:0@lo:400:kworker.0 00010000:00080000:2.0:1788359504.580191:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2751180 x1875230445454208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.580200:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445454208:0@lo:400:kworker.0 00010000:00080000:2.0:1788359504.580210:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0e9c80edc00 x1875230445453440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.580219:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445453440:0@lo:400:kworker.0 00010000:00080000:2.0:1788359504.580229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0ead2752300 x1875230445454080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359504.580248:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2752300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445454080:0@lo:400:kworker.0 00002000:00080000:0.0:1788359504.584426:0:18793:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788359504.584438:0:18793:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788359504.584443:0:18793:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:1.0:1788359504.584747:0:17169:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788359504.593704:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.593716:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.593731:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.593736:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.593743:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.593762:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.593772:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.593779:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.593800:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359504.593957:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359504.593964:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.593972:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359504.593977:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.593986:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594002:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594026:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4bc118c/0x49dd053b5feaf86c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594043:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.594045:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.594047:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359504.594644:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359504.594651:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594661:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788359504.594665:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359504.594669:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594679:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594687:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594695:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594711:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359504.594719:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359504.594730:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594738:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359504.594741:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594749:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594757:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594761:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b085b65/0x49dd053b5feaf873 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.594776:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.594777:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.594778:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359504.595126:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359504.595132:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.595141:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788359504.595144:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359504.595148:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.595168:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.595176:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.595183:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.595203:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788359504.595427:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359504.595433:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.595441:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359504.595451:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.595459:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.595471:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.595478:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b7b8a7a/0x49dd053b5feaf87a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.595569:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.595572:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.595573:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.596110:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.596117:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.596128:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.596131:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.596135:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.596145:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.596155:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.596171:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.596194:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.596374:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.596382:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.596390:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.596394:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.596410:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.596425:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.596433:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ba0e48/0x49dd053b5feaf881 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.596452:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.596453:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.596455:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.597805:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.597817:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.597835:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.597840:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.597846:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.597859:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.597870:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.597880:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.597937:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788359504.598324:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.598331:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.598344:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.598347:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.598352:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.598361:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.598370:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.598377:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598421:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359504.598428:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598436:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359504.598440:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598459:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598474:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598482:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07c48fd/0x49dd053b5feaf888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598528:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359504.598532:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598539:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eac00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359504.598542:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598549:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598559:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.598567:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359504.598569:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359504.598576:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.598709:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.598714:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098c1decd/0x49dd053b5feaf88f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.599001:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.599020:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599028:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.599031:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.599035:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599054:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599063:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599069:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.599100:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.599105:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.599112:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.599116:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.599123:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.599134:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.599154:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.599156:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.599158:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.599222:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.599226:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92b4930/0x49dd053b5feaf896 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.599565:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.599571:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599579:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.599583:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.599587:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599596:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599615:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.599622:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.600106:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359504.600112:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.600120:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359504.600123:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.600132:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.600143:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359504.600151:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359504.600152:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359504.600154:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.600255:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.600261:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1f1ea78/0x49dd053b5feaf89d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.600677:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.600683:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.600693:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.600697:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.600701:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.600711:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.600719:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.600737:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.600780:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.600785:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.600792:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.600795:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.600803:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.600814:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.600822:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.600824:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.600826:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.600952:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.600957:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082353435/0x49dd053b5feaf8a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601255:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.601330:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.601336:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601345:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.601349:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.601353:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601362:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601371:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601378:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601409:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.601621:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.601626:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601634:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.601641:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601650:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601660:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601667:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b93b1c/0x49dd053b5feaf8ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.601680:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.601681:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.601682:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.601824:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.601830:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601838:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.601841:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.601845:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601854:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601862:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601869:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.601890:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.602116:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.602122:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602131:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.602134:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602143:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602154:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602166:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001383d7f0/0x49dd053b5feaf8b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602181:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.602183:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.602184:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.602252:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.602258:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602266:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.602274:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.602278:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602288:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602297:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602304:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602325:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.602558:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.602563:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602571:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3c00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.602575:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602583:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602594:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602601:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eae181f/0x49dd053b5feaf8b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602614:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.602616:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.602617:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.602699:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.602706:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602714:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.602717:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.602721:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602730:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602738:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602750:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.602770:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.602973:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.602978:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602986:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.602989:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.602997:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.603020:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.603028:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081af9532/0x49dd053b5feaf8c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.603044:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.603046:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.603047:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.603114:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.603119:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603128:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.603131:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.603134:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603142:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603149:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603155:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603204:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788359504.603526:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.603532:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603546:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.603549:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.603553:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603562:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603570:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.603576:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606560:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359504.606575:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606587:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.606592:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606617:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606636:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606643:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ee4983d/0x49dd053b5feaf8c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606665:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.606669:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606675:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.606678:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606685:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606693:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.606700:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.606702:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.606710:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.606855:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.606863:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be95325b/0x49dd053b5feaf8ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.607336:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.607343:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607354:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.607358:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.607363:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607385:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607395:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607402:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607416:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.607674:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.607679:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.607688:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.607692:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.607700:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.607713:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.607720:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085e85ae8/0x49dd053b5feaf8d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.607734:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.607736:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.607737:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.607743:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.607923:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.607929:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607937:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.607940:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.607944:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607953:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607961:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607977:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.607996:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359504.608232:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.608238:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608246:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.608249:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608262:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608274:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608281:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a84f51ef/0x49dd053b5feaf8dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608295:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.608297:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.608298:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.608364:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.608370:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608378:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.608381:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.608385:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608394:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608402:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608407:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608459:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788359504.608791:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.608797:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608810:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.608813:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.608817:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608826:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608834:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.608842:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608974:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359504.608980:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608987:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.608990:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.608997:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609020:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609039:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004910397e/0x49dd053b5feaf8e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609054:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.609058:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609064:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2c00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.609068:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609075:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609086:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609094:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.609096:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.609099:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.609161:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.609166:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3429913/0x49dd053b5feaf8ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.609547:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.609553:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.609563:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.609567:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.609571:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.609592:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.609599:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.609606:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609727:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.609732:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609739:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.609749:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609758:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609770:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.609778:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.609780:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.609782:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.609846:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.609851:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002128ff4d/0x49dd053b5feaf8f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.610142:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.610147:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610156:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.610158:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.610162:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610170:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610186:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610192:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610220:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.610224:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610231:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.610233:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610240:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610250:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610257:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.610263:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.610265:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.610316:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.610320:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbc70194/0x49dd053b5feaf8f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.610665:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.610671:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610680:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.610683:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.610687:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610696:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610704:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.610724:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610764:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.610769:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610776:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.610780:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610789:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610800:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.610808:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.610810:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.610812:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.610874:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.610879:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d792f3/0x49dd053b5feaf8ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.611163:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.611169:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611177:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.611180:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.611185:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611194:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611202:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611209:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.611245:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.611250:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.611257:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.611260:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.611268:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.611284:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.611291:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.611293:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.611295:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359504.611355:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788359504.611360:0:18793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b46cc331/0x49dd053b5feaf906 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788359504.611682:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.611688:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611695:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.611698:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.611702:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611710:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611718:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611725:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.611748:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788359504.612040:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359504.612041:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359504.612047:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612047:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612055:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec11b600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359504.612059:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=536s v=(0 0) 00010000:00010000:1.0:1788359504.612059:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612063:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.612067:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612068:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612076:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612079:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612084:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612086:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5cae5d8/0x49dd053b5feaf90d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612091:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612100:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359504.612104:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359504.612107:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612113:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec11b800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359504.612116:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612123:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612132:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612139:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be26a869/0x49dd053b5feaf914 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612150:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.612152:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.612154:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.612362:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.612368:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612376:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.612379:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.612383:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612392:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612410:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612417:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612437:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359504.612584:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359504.612589:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612596:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec11b400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359504.612606:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612614:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612625:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612633:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007427d34c/0x49dd053b5feaf91b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359504.612646:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.612648:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359504.612650:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788359504.612747:0:18793:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788359504.612753:0:18793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612762:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=536s v=(0 0) 00010000:00010000:2.0:1788359504.612765:0:18793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359504.612769:0:18793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612778:0:18793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612786:0:18793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612792:0:18793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359504.612822:0:18793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788359504.612849:0:18793:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788359504.612932:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17214:x1875230445454464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 34255us (34660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359504.612940:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788359504.613023:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359504.613028:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.613035:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec11ae00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359504.613039:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.613045:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.613055:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359504.613061:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17214:1875230445454464:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1788359504.613062:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e10552d6/0x49dd053b5feaf922 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359504.613075:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788359504.613076:0:17214:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00010000:00010000:0.0:1788359504.613077:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359504.613079:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359504.613123:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17214:1875230445454592:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788359504.613157:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359504.613189:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1788359504.613200:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359504.613204:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454592 00000100:00100000:0.0:1788359504.613211:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454592 00000100:00100000:0.0:1788359504.613257:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359504.613266:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17214:x1875230445454592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788359504.613299:0:18696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1788359504.617812:0:18692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788359504.617877:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788359504.618088:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17214:x1875230445454592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4818us (4924us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788359504.618098:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788359504.618403:0:17214:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788359504.618412:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17214:1875230445454592:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788359504.618428:0:17214:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:0.0:1788359504.764714:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359505.086560:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445454720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788359505.086629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.086727:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454720 00000100:00100000:3.0:1788359505.086733:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454720 00000100:00100000:3.0:1788359505.086770:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788359505.086777:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445454720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359505.086807:0:17929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788359505.086862:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445454720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.086868:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788359505.086904:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445454720:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1788359505.680042:0:19509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788359505.680047:0:19509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788359505.680049:0:19509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788359505.680195:0:19509:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0eafd872000 00000020:01000004:3.0:1788359505.680212:0:19509:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788359505.680227:0:19509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788359505.680240:0:19509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0e9c56399c0) 00000020:00000080:3.0:1788359505.680256:0:19509:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788359505.720005:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788359505.725859:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788359505.726365:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788359505.726578:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788359505.726770:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788359505.726949:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788359505.727230:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1788359505.728320:0:19509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788359505.728688:0:19509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788359505.728701:0:19509:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788359505.728713:0:19509:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49dd053b5feaf930 00000020:01000004:2.0:1788359505.728719:0:19509:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788359505.728742:0:19509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788359505.728745:0:19509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788359505.728751:0:19509:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788359505.728779:0:19509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788359505.728783:0:19509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788359505.740045:0:19509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788359505.740143:0:19509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.152@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788359505.740149:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788359505.740151:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788359505.740153:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359505.740154:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359505.740155:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359505.740157:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359505.740158:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359505.740160:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359505.740162:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788359505.740166:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788359505.740169:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788359505.740170:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788359505.740171:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359505.740173:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359505.740174:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359505.740175:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359505.740176:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359505.740177:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359505.740178:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788359505.740204:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788359505.740224:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445454848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788359505.740295:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.740389:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec1c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.740435:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454848 00000100:00100000:2.0:1788359505.740443:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454848 00000100:00100000:1.0:1788359505.740627:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788359505.740646:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:19509:x1875230445454848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788359505.740677:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788359505.740680:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788359505.740684:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788359505.741063:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:19509:x1875230445454848:12345-0@lo:253:mount.lustre.0 Request processed in 420us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359505.741071:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788359505.741205:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445454848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788359505.741216:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788359505.741218:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788359505.741220:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788359505.741221:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788359505.741222:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788359505.741223:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788359505.741224:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788359505.741225:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788359505.741226:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788359505.741228:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788359505.741247:0:19509:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0eafd872000 from lustre-OST0001 10000000:01000000:0.0:1788359505.741272:0:19509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788359505.741275:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788359505.741283:0:19509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0e9c6870000 local copy 00010000:00010000:0.0:1788359505.741292:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359505.741377:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445454976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359505.741406:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.741473:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec1c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.741641:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445454976 00000100:00100000:2.0:1788359505.741647:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445454976 00000100:00100000:2.0:1788359505.741716:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788359505.741724:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:19509:x1875230445454976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359505.741798:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+21:19509:x1875230445454976:12345-0@lo:501:mount.lustre.0 Request processed in 74us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788359505.741805:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788359505.741855:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445454976:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788359505.741867:0:19509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788359505.741883:0:19509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788359505.741888:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.741897:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8a00/0x49dd053b5feaf586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf58d expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359505.741919:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0eafd872000 10000000:01000000:0.0:1788359505.741928:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788359505.741932:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788359505.741934:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788359505.741938:0:19509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788359505.741941:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788359505.741958:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.741965:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.741973:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359505.741984:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359505.742019:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.742092:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec1c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359505.742157:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455104 00000100:00100000:1.0:1788359505.742161:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455104 00000100:00100000:1.0:1788359505.742181:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788359505.742187:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:19509:x1875230445455104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788359505.742195:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359505.742208:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac7181e00/0x49dd053b5feaf93e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf937 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.742227:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac7181e00/0x49dd053b5feaf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf937 expref: 22 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.742238:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac7181e00/0x49dd053b5feaf93e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf937 expref: 22 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.742247:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac7181e00, rc 0) 00000100:00100000:1.0:1788359505.742284:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455104:12345-0@lo:101:mount.lustre.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359505.742290:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788359505.742348:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359505.742360:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf93e expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.742369:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf93e expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359505.743287:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788359505.743841:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359505.745331:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788359505.745369:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788359505.745385:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788359505.745403:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788359505.745426:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788359505.745438:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788359505.745459:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788359505.745464:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788359505.745654:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359505.745716:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.745801:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.745902:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455232 00000100:00100000:2.0:1788359505.745910:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455232 00000100:00100000:3.0:1788359505.746012:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788359505.746024:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359505.746172:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455232:12345-0@lo:501:mount.lustre.0 Request processed in 151us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.746180:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788359505.746246:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359505.746274:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455360:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788359505.746310:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.746405:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359505.746449:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455360 00000100:00100000:1.0:1788359505.746454:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455360 00000100:00100000:1.0:1788359505.746475:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788359505.746482:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359505.747107:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455360:12345-0@lo:503:mount.lustre.0 Request processed in 623us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359505.747115:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788359505.747233:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788359505.747713:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788359505.747784:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788359505.747822:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.747850:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788359505.747921:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455488 00000100:00100000:1.0:1788359505.747926:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455488 00000100:00100000:1.0:1788359505.747959:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788359505.747966:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359505.748300:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455488:12345-0@lo:502:mount.lustre.0 Request processed in 334us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359505.748308:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788359505.748397:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788359505.748655:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788359505.748681:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788359505.748694:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788359505.748705:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788359505.748717:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788359505.748730:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788359505.748743:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788359505.748757:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788359505.748768:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788359505.748788:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.748824:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.748847:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359505.748947:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455616 00000100:00100000:0.0:1788359505.748952:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455616 00000100:00100000:0.0:1788359505.748973:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788359505.748979:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788359505.749073:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455616:12345-0@lo:502:mount.lustre.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359505.749081:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788359505.749198:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788359505.749232:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788359505.749240:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788359505.749986:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788359505.750005:0:19513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788359505.750013:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.750015:0:19513:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788359505.750021:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788359505.750035:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0eaece119c0) 00000020:00000080:2.0:1788359505.750059:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788359505.750071:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788359505.750145:0:19513:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eafd872000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788359505.750153:0:19513:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788359505.750159:0:19513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x49dd053b5feaf94c 00010000:00010000:2.0:1788359505.754463:0:19513:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788359505.755159:0:19513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788359505.756655:0:19513:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788359505.757710:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788359505.757721:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359505.757727:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.757729:0:19513:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788359505.757734:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359505.757737:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.757739:0:19513:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788359505.757742:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788359505.757743:0:19513:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788359505.757746:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359505.757748:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.757749:0:19513:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788359505.757752:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788359505.757754:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.757755:0:19513:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788359505.757759:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788359505.757779:0:19513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788359505.757782:0:19513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788359505.757783:0:19513:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788359505.757786:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788359505.757992:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788359505.758031:0:19509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788359505.758055:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf93e expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.758073:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9000/0x49dd053b5feaf937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf93e expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359505.758082:0:19509:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eafd872000 from 1 10000000:01000000:0.0:1788359505.758084:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359505.758120:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.758127:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.758138:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359505.758161:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788359505.758227:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.758276:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.758328:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455744 00000100:00100000:2.0:1788359505.758335:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455744 00000100:00100000:2.0:1788359505.758387:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788359505.758396:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:19509:x1875230445455744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359505.758412:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359505.758430:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf953 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.758454:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.758466:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.758476:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11a200, rc 0) 00000100:00100000:2.0:1788359505.758540:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445455744:12345-0@lo:101:mount.lustre.0 Request processed in 145us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.758547:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788359505.758685:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359505.758699:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.758709:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359505.759674:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788359505.759902:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359505.760068:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788359505.760104:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788359505.760133:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788359505.760139:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788359505.760192:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788359505.760235:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359505.760317:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6a30900 going to sleep for 11 seconds 00000100:00100000:3.0:1788359505.764662:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445455872 00000100:00100000:3.0:1788359505.764675:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445455872 00000100:00100000:3.0:1788359505.764762:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788359505.764772:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445455872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788359505.764941:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445455872:12345-0@lo:501:mount.lustre.0 Request processed in 171us (4705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.764949:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788359505.766527:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445455872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788359505.766581:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788359505.766636:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359505.766809:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142480 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.766894:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456000 00000100:00100000:2.0:1788359505.766900:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456000 00000100:00100000:2.0:1788359505.766933:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788359505.766940:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359505.767054:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456000:12345-0@lo:503:mount.lustre.0 Request processed in 113us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.767062:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788359505.767136:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788359505.767615:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788359505.767680:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359505.767717:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359505.767741:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c688ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.767796:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456128 00000100:00100000:2.0:1788359505.767800:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456128 00000100:00100000:2.0:1788359505.767818:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788359505.767824:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.767903:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456128:12345-0@lo:502:mount.lustre.0 Request processed in 78us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.767910:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788359505.767977:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359505.768158:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788359505.768185:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788359505.768200:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788359505.768214:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788359505.768225:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788359505.768248:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788359505.768273:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788359505.768288:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788359505.768302:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788359505.768315:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788359505.768328:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788359505.768347:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788359505.768382:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359505.768436:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaff142480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359505.768523:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456256 00000100:00100000:3.0:1788359505.768528:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456256 00000100:00100000:2.0:1788359505.770610:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788359505.770652:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.770786:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456256:12345-0@lo:502:mount.lustre.0 Request processed in 143us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.770795:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788359505.770912:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788359505.770983:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788359505.771012:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788359505.772725:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359505.772735:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.772737:0:19517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788359505.772743:0:19517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eafd872000 00000020:00000080:0.0:1788359505.772746:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788359505.772753:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359505.772755:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.772757:0:19517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788359505.772759:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359505.772761:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.772763:0:19517:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788359505.772766:0:19517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0eafd872000 00000020:00000080:0.0:1788359505.772768:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788359505.772856:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359505.772860:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.772862:0:19517:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788359505.772864:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359505.772866:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.772867:0:19517:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788359505.772871:0:19517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eafd872000 00000020:00000080:0.0:1788359505.772872:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788359505.773676:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359505.773682:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.773683:0:19517:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788359505.773687:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788359505.773689:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.773691:0:19517:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788359505.773694:0:19517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0eafd872000 00000020:00000080:0.0:1788359505.773702:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788359505.773734:0:19517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788359505.773738:0:19517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788359505.773739:0:19517:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788359505.773742:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788359505.783060:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788359505.783107:0:19509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359505.783129:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.783141:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359505.783203:0:19509:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788359505.783206:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0eafd872000 10000000:01000000:2.0:1788359505.783209:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0eafd872000 10000000:01000000:2.0:1788359505.783213:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788359505.783219:0:19509:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0eafd872000 from 1 10000000:01000000:2.0:1788359505.783221:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788359505.783254:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.783263:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.783275:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359505.783299:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788359505.783363:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.783412:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788359505.787297:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456384 00000100:00100000:0.0:1788359505.787312:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456384 00000100:00100000:0.0:1788359505.787371:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788359505.787383:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+23:19509:x1875230445456384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788359505.787400:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359505.787418:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac91c9400/0x49dd053b5feaf968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf961 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.787444:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac91c9400/0x49dd053b5feaf968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf961 expref: 24 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.787455:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac91c9400/0x49dd053b5feaf968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf961 expref: 24 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.787465:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9400, rc 0) 00000100:00100000:0.0:1788359505.787569:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456384:12345-0@lo:101:mount.lustre.0 Request processed in 188us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359505.787575:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788359505.787605:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788359505.787624:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf968 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.787635:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf968 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.788597:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788359505.788898:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788359505.789184:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788359505.789375:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788359505.789404:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788359505.789424:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788359505.789440:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788359505.789457:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788359505.789474:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788359505.789490:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788359505.789543:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788359505.789560:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788359505.789577:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788359505.789609:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788359505.789631:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788359505.789651:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788359505.789667:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788359505.789684:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788359505.789701:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788359505.789720:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788359505.789740:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788359505.789757:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788359505.789777:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788359505.789794:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788359505.789823:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788359505.789842:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788359505.789861:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788359505.789877:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788359505.789891:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788359505.789915:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788359505.789930:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788359505.789945:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788359505.789962:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788359505.789978:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788359505.790007:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788359505.790025:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788359505.790039:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788359505.790053:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788359505.790067:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788359505.790083:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788359505.790097:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788359505.790113:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788359505.790128:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788359505.790144:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788359505.790159:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788359505.790189:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788359505.790208:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788359505.790223:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788359505.790239:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788359505.790261:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788359505.790268:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788359505.790346:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359505.790400:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.790436:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.790457:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456512 00000100:00100000:2.0:1788359505.790463:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456512 00000100:00100000:2.0:1788359505.790526:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359505.790536:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359505.790648:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456512:12345-0@lo:501:mount.lustre.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.790656:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788359505.790704:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788359505.790735:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456640:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359505.790776:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.790799:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.790810:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456640 00000100:00100000:2.0:1788359505.790813:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456640 00000100:00100000:2.0:1788359505.790837:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788359505.790844:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788359505.790918:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456640:12345-0@lo:503:mount.lustre.0 Request processed in 74us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.790926:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788359505.790980:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456640:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788359505.791323:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788359505.791375:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456768:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.791408:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.791424:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.791447:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456768 00000100:00100000:2.0:1788359505.791451:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456768 00000100:00100000:2.0:1788359505.791474:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359505.791480:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.791574:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456768:12345-0@lo:502:mount.lustre.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.791581:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788359505.791618:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788359505.791748:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788359505.791769:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788359505.791782:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788359505.791794:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788359505.791807:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788359505.791819:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788359505.791831:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788359505.791843:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788359505.791857:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788359505.791880:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788359505.791894:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788359505.791907:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788359505.791918:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788359505.791931:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788359505.791944:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788359505.791957:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788359505.791971:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788359505.791984:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788359505.794807:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788359505.794865:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788359505.794887:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788359505.794907:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788359505.794925:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788359505.794961:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788359505.794978:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788359505.795009:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788359505.795031:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788359505.795051:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788359505.795072:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788359505.795097:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788359505.795120:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788359505.795142:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788359505.795164:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788359505.795180:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788359505.795198:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788359505.795214:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788359505.795229:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788359505.795246:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788359505.795264:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788359505.795294:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788359505.795310:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788359505.795323:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788359505.795336:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788359505.795348:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788359505.795361:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788359505.795374:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788359505.795386:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788359505.795398:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788359505.795453:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359505.795682:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.795759:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.795806:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445456896 00000100:00100000:2.0:1788359505.795813:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445456896 00000100:00100000:2.0:1788359505.795889:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788359505.795898:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.796017:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445456896:12345-0@lo:502:mount.lustre.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.796025:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788359505.796133:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445456896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359505.796342:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788359505.796368:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788359505.796393:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445457024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788359505.796427:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.796445:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafed710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359505.796483:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457024 00000100:00100000:2.0:1788359505.796487:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457024 00000100:00100000:2.0:1788359505.796659:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788359505.796667:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445457024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788359505.796738:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445457024:12345-0@lo:502:mount.lustre.0 Request processed in 71us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.796745:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788359505.796810:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445457024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788359505.796856:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788359505.796866:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788359505.797854:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788359505.797872:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0e9c563b380) 00000020:00000080:3.0:1788359505.797896:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788359505.798109:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eafd872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359505.798114:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eafd872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359505.798118:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eafd872000 3 00010000:00080000:3.0:1788359505.798162:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c698a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.152@tcp at head 00010000:00010000:3.0:1788359505.801466:0:19522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788359505.801975:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788359505.802034:0:19522:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788359505.802047:0:19522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x49dd053b5feaf976 00000100:00080000:3.0:1788359505.802058:0:19522:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359505.802064:0:19522:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0e9c698a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359505.802101:0:19522:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9180 x1875230445457152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359505.802155:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445457152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788359505.802221:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788359505.802275:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788359505.802319:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359505.802324:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788359505.802332:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359505.802337:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1788359505.802340:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788359505.802344:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0eb0068a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359505.802358:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0ead27b9880 x1875230445457408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788359505.802399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788359505.802403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788359505.802404:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788359505.802408:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:3.0:1788359505.802410:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788359505.802414:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359505.802428:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c803c380 x1875230445457920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788359505.802471:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445457280:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.802566:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445458048:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802592:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445457536:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802618:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445457664:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802642:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.802663:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445458304:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802691:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445457792:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802714:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.802767:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457280 00000100:00100000:3.0:1788359505.802775:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457280 00000100:00100000:3.0:1788359505.802811:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457792 00000100:00100000:3.0:1788359505.802814:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457792 00000100:00100000:3.0:1788359505.802850:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359505.802860:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445457280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802910:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445457280:12345-0@lo:400:kworker.0 Request processed in 52us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.802918:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788359505.802937:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359505.802943:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445457792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.802976:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445457792:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.802982:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359505.803127:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445457408:0@lo:8:kworker.0 00000100:00100000:1.0:1788359505.803150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359505.803174:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445457920:0@lo:8:kworker.0 00000100:00100000:1.0:1788359505.803195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.803271:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457152 00000100:00100000:2.0:1788359505.803275:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457152 00000100:00100000:2.0:1788359505.803298:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359505.803303:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1875230445457152:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788359505.803327:0:18578:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1788359505.803442:0:18578:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x49dd053b5feaf97d 00000004:00100000:2.0:1788359505.803456:0:18578:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788359505.803484:0:18578:0:(import.c:65:import_set_state_nolock()) ffffa0e9c14e6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359505.803667:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875230445457152:12345-0@lo:38:llog_process_th.0 Request processed in 359us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.803699:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788359505.804189:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457408 00000100:00100000:3.0:1788359505.804195:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457408 00000100:00100000:3.0:1788359505.804210:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457920 00000100:00100000:3.0:1788359505.804212:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457920 00000100:00100000:3.0:1788359505.804221:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359505.804226:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445457408:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788359505.804241:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788359505.804249:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445457920:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788359505.804274:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3641:x1875230445457408:12345-0@lo:8:kworker.0 Request processed in 46us (1121us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788359505.804281:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788359505.804300:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457664 00000100:00100000:3.0:1788359505.804303:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457664 00000100:00100000:3.0:1788359505.804327:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359505.804332:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445457664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359505.804375:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2753100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445457920:12345-0@lo:8:kworker.0 Request processed in 124us (1178us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788359505.804382:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359505.804386:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445457664:12345-0@lo:400:kworker.0 Request processed in 50us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.804402:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788359505.804435:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.804461:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.804547:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445457536 00000100:00100000:3.0:1788359505.804551:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445457536 00000100:00100000:3.0:1788359505.804571:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458176 00000100:00100000:3.0:1788359505.804574:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458176 00000100:00100000:3.0:1788359505.804586:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788359505.804592:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445457536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804626:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875230445457536:12345-0@lo:400:kworker.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.804633:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788359505.804646:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788359505.804653:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445458176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804680:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875230445458176:12345-0@lo:400:kworker.0 Request processed in 28us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.804686:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788359505.804724:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27bad80 x1875230445457536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359505.804738:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875230445457536:0@lo:400:kworker.0 00010000:00080000:3.0:1788359505.804757:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c803df80 x1875230445458176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359505.804766:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3645:1875230445458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804804:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445457792:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804830:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.804868:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445457664:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804886:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458304 00000100:00100000:3.0:1788359505.804889:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458304 00000100:00100000:3.0:1788359505.804912:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359505.804918:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445458304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.804960:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875230445458304:12345-0@lo:400:kworker.0 Request processed in 42us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.804968:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788359505.805005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.805040:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445457280:0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.805061:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458048 00000100:00100000:3.0:1788359505.805065:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458048 00000100:00100000:3.0:1788359505.805091:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788359505.805097:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445458048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359505.805133:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875230445458048:12345-0@lo:400:kworker.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.805139:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788359505.805167:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c803e300 x1875230445458304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359505.805177:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3642:1875230445458304:0@lo:400:kworker.0 00010000:00080000:3.0:1788359505.805197:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c803d500 x1875230445458048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359505.805206:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875230445458048:0@lo:400:kworker.0 00000020:01000004:3.0:1788359505.805397:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788359505.805415:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffffa0e9c563cd40) 00000020:00000080:3.0:1788359505.805435:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788359505.805617:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0eafd872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359505.805622:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0eafd872000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788359505.805624:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0eafd872000 3 00010000:00080000:3.0:1788359505.805649:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0e9c6988800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.152@tcp at head 00010000:00080000:1.0:1788359505.807182:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead27b9180 x1875230445457152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359505.807195:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359505.807204:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788359505.807211:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788359505.807216:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788359505.807219:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c698a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359505.807226:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3641:1875230445457152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788359505.807260:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359505.807263:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359505.807267:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788359505.807270:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445457408:0@lo:8:kworker.0 00000100:00100000:1.0:1788359505.807279:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359505.807281:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788359505.807284:0:3641:0:(import.c:1517:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788359505.807287:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445457920:0@lo:8:kworker.0 00010000:00010000:3.0:1788359505.809305:0:19522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788359505.809396:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788359505.809440:0:19522:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788359505.809454:0:19522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x49dd053b5feaf98b 00000100:00080000:3.0:1788359505.809463:0:19522:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788359505.809469:0:19522:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffffa0e9c6988800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:3.0:1788359505.809713:0:19522:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c803d500 x1875230445458432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788359505.809763:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445458432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788359505.809833:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.809912:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458432 00000100:00100000:2.0:1788359505.809920:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458432 00000100:00100000:2.0:1788359505.809957:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359505.809964:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875230445458432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788359505.809988:0:17189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:2.0:1788359505.810042:0:17189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x49dd053b5feaf992 00000004:00100000:2.0:1788359505.810057:0:17189:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788359505.810087:0:17189:0:(import.c:65:import_set_state_nolock()) ffffa0e9c14e3000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788359505.810144:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788359505.810461:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:2.0:1788359505.811352:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875230445458432:12345-0@lo:38:llog_process_th.0 Request processed in 1384us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359505.811369:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:2.0:1788359505.811407:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788359505.811443:0:19509:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788359505.811466:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf968 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359505.811477:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaec11a400/0x49dd053b5feaf961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf968 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788359505.811550:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788359505.811552:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788359505.811554:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359505.811555:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359505.811556:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359505.811558:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359505.811559:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359505.811561:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359505.811562:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359505.811566:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788359505.811569:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788359505.811570:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788359505.811571:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359505.811573:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359505.811574:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359505.811575:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359505.811576:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359505.811577:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359505.811579:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788359505.811596:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788359505.811611:0:19509:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445458560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788359505.811658:0:19509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359505.811688:0:19509:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaca1b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788359505.811825:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458560 00000100:00100000:3.0:1788359505.811832:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458560 00000100:00100000:3.0:1788359505.811879:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788359505.811889:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445458560:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788359505.811913:0:17184:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788359505.811926:0:17184:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788359505.812130:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c803d500 x1875230445458432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788359515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359505.812142:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788359505.812150:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788359505.812157:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788359505.812161:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788359505.812164:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6988800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788359505.812171:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3641:1875230445458432:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788359505.816634:0:17184:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788359505.816652:0:17184:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788359505.816666:0:17205:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788359505.816670:0:17205:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788359505.816692:0:17205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816711:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816731:0:17205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816739:0:17205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816775:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816790:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359505.816807:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445458688:0@lo:104: 00000100:00100000:1.0:1788359505.816868:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.816884:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:19509:x1875230445458560:12345-0@lo:253:mount.lustre.0 Request processed in 4996us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.816895:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788359505.816899:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458688 00000100:00100000:0.0:1788359505.816909:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458688 00010000:00010000:1.0:1788359505.816915:0:17205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.816924:0:17205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359505.816934:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445458816:0@lo:104: 00000100:00100000:0.0:1788359505.816947:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359505.816958:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445458688:12345-0@lo:104: 00000100:00100000:1.0:1788359505.816963:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359505.816975:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359505.816978:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead15d1c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788359505.817038:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788359505.817044:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445458688:12345-0@lo:104: Request processed in 89us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359505.817050:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788359505.817062:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458816 00000100:00100000:0.0:1788359505.817065:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458816 00000100:00100000:0.0:1788359505.817076:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788359505.817080:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445458816:12345-0@lo:104: 00010000:00010000:0.0:1788359505.817088:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817123:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788359505.817129:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2752d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:17205:x1875230445458816:12345-0@lo:104: Request processed in 48us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359505.817135:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788359505.817154:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788359505.817159:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817167:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359505.817171:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817190:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359505.817198:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788359505.817202:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359505.817231:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817239:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359505.817264:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817272:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eb400/0x49dd053b5feaf857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf85e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359505.817282:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445458944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359505.817286:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359505.817290:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817303:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9200 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:0.0:1788359505.817307:0:17178:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817314:0:17178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788359505.817321:0:17178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359505.817331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788359505.817338:0:17178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788359505.817357:0:17178:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817362:0:17178:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788359505.817377:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359505.817381:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9200/0x49dd053b5feaf849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf850 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359505.817389:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445458944 00010000:00010000:0.0:1788359505.817392:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359505.817395:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445458944 00010000:00010000:0.0:1788359505.817395:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359505.817397:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359505.817420:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359505.817421:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445458688:0@lo:104: 00000100:00100000:0.0:1788359505.817438:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17205:1875230445458816:0@lo:104: 00000100:00100000:3.0:1788359505.817453:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788359505.817460:0:17205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359505.817462:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3643:x1875230445458944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359505.817697:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359505.817705:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817717:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817731:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac91c8800/0x49dd053b5feaf85e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf857 expref: 24 pid: 17184 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817742:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359505.817777:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:caaeac2e-9afd-44da-91ff-e628fee28e20+23:3643:x1875230445458944:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.817784:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788359505.817807:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445459072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359505.817833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359505.817888:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459072 00000100:00100000:3.0:1788359505.817892:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459072 00010000:00010000:3.0:1788359505.817908:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359505.817929:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788359505.817944:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:3644:x1875230445459072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359505.817953:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359505.817958:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817967:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817978:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0031c00/0x49dd053b5feaf850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf849 expref: 23 pid: 17182 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.817990:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359505.818122:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359505.818127:0:19509:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:caaeac2e-9afd-44da-91ff-e628fee28e20:19509:1875230445458560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788359505.818150:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788359505.818154:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788359505.818156:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788359505.818158:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788359505.818159:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788359505.818161:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788359505.818162:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788359505.818164:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788359505.818166:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788359505.818178:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788359505.818196:0:19509:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788359505.818583:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788359505.818598:0:17174:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003752711s 00010000:00010000:3.0:1788359505.818602:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818609:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818615:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818621:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818627:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359505.818636:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818643:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818657:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818669:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359505.818702:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:3644:x1875230445459072:12345-0@lo:103:ldlm_bl.0 Request processed in 761us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359505.818709:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788359505.818754:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445459072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788359505.818777:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445458944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788359505.818796:0:17205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818804:0:17205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359505.818810:0:17205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac7180400/0x49dd053b5feaf999 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788359505.824628:0:19509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788359505.827287:0:19509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788359505.827298:0:19509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788359505.827334:0:19509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788359505.827374:0:19509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788359505.827394:0:19509:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788359505.827415:0:19509:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788359505.828267:0:19509:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788359505.828490:0:19509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788359506.337784:0:19575:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788359506.337946:0:19575:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788359506.813602:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788359507.516660:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788359507.516667:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0eaffa8a000 from 10 10000000:01000000:3.0:1788359507.516673:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359507.516719:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.516748:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.516759:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359507.516784:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359507.516842:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359507.516886:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788359507.516891:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459200 00000100:00100000:2.0:1788359507.516899:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459200 00000100:00100000:2.0:1788359507.517001:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788359507.517009:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445459200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359507.517020:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359507.517031:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11b200/0x49dd053b5feaf9a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf9a0 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359507.517049:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11b200/0x49dd053b5feaf9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf9a0 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359507.517056:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11b200/0x49dd053b5feaf9a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf9a0 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359507.517071:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11b200, rc 0) 00000100:00100000:2.0:1788359507.517107:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445459200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359507.517114:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788359507.517140:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359507.517154:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9a7 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.517163:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf9a7 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359507.517207:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788359507.517233:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359507.517252:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788359507.517287:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459328 00000100:00100000:0.0:1788359507.517292:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459328 00000100:00100000:0.0:1788359507.517352:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788359507.517358:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445459328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788359507.517370:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788359507.517383:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788359507.517385:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788359507.517476:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445459328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359507.517490:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788359507.517531:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 10000000:01000000:3.0:1788359507.517630:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359507.517637:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9a7 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.517645:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7600/0x49dd053b5feaf9a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9a7 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359507.517664:0:17186:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788359507.517666:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0ead20a0000 from 10 10000000:01000000:3.0:1788359507.517668:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788359507.517682:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.517688:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.517695:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359507.517708:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359507.517732:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359507.517819:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359507.517866:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459456 00000100:00100000:1.0:1788359507.517870:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459456 00000100:00100000:1.0:1788359507.517889:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788359507.517898:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445459456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788359507.517904:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359507.517910:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eac7181c00/0x49dd053b5feaf9b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feaf9ae expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359507.517920:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac7181c00/0x49dd053b5feaf9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feaf9ae expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359507.517925:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eac7181c00/0x49dd053b5feaf9b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf9ae expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359507.517930:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac7181c00, rc 0) 00000100:00100000:1.0:1788359507.517970:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445459456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359507.517975:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788359507.518061:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359507.518068:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9b5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.518074:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feaf9b5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359507.518099:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788359507.518117:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359507.518136:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae4ff0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788359507.518186:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459584 00000100:00100000:1.0:1788359507.518191:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459584 00000100:00100000:1.0:1788359507.518208:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788359507.518213:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445459584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788359507.518223:0:17182:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788359507.518233:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788359507.518236:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788359507.518316:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445459584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359507.518322:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788359507.518445:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445459584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788359507.518519:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788359507.518528:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9b5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359507.518533:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7800/0x49dd053b5feaf9ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feaf9b5 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359507.645383:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359507.645408:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445459712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359507.645478:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359507.645707:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459712 00000100:00100000:0.0:1788359507.645716:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459712 00000100:00080000:2.0:1788359507.645793:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359507.645843:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788359507.645895:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445459712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788359507.645920:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788359507.646020:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2750e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445459712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359507.646027:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359507.646033:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445459712:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788359507.836678:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359508.157793:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445459840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788359508.157876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359508.159608:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459840 00000100:00100000:0.0:1788359508.159620:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459840 00000100:00100000:0.0:1788359508.159675:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788359508.159686:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445459840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788359508.159724:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788359508.159799:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445459840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359508.159806:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788359508.159865:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445459840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788359508.862148:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788359508.898475:0:19864:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg252-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788359509.181286:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788359509.362526:0:19916:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788359509.362762:0:19916:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788359509.693548:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445459968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359509.693629:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359509.694140:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445459968 00000100:00100000:1.0:1788359509.694151:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445459968 00000100:00100000:1.0:1788359509.694266:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788359509.694276:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445459968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359509.694307:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788359509.694359:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445459968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359509.694367:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359509.694403:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead2751180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445459968:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788359509.694447:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:3.0:1788359509.832210:0:19967:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788359509.832417:0:19967:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788359509.891008:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359509.974311:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359509.974420:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223232 00000100:00100000:2.0:1788359509.974432:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223232 00000100:00100000:0.0:1788359509.974697:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 110 00000100:00100000:0.0:1788359509.974708:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2401:x1875230420223232:12345-192.168.202.52@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788359509.974738:0:17184:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8e20f3f2-a4c2-4c6c-95b2-c4846e9720de@192.168.202.52@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:0.0:1788359509.974773:0:17184:0:(genops.c:1406:class_connect()) connect: client 8e20f3f2-a4c2-4c6c-95b2-c4846e9720de, cookie 0x49dd053b5feaf9bc 00000100:00080000:0.0:1788359509.974919:0:17184:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359509.975035:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+5:2401:x1875230420223232:12345-192.168.202.52@tcp:250:mount.lustre.0 Request processed in 327us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359509.975043:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 110 00000100:00100000:1.0:1788359509.983475:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359509.983809:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223360 00000100:00100000:2.0:1788359509.983819:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223360 00000100:00100000:2.0:1788359509.983931:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 111 00000100:00100000:2.0:1788359509.983942:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+5:14921:x1875230420223360:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359509.983971:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359509.983992:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11ac00/0x49dd053b5feaf9c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7235 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.984022:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11ac00/0x49dd053b5feaf9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7235 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.984034:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11ac00/0x49dd053b5feaf9c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7235 expref: 6 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.984043:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11ac00, rc 0) 00000100:00100000:2.0:1788359509.984147:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+6:14921:x1875230420223360:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 206us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359509.984168:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 111 00000100:00100000:1.0:1788359509.987996:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359509.988080:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223488 00000100:00100000:0.0:1788359509.988090:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223488 00000100:00100000:0.0:1788359509.988153:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 112 00000100:00100000:0.0:1788359509.988165:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+6:14921:x1875230420223488:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788359509.988292:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+6:14921:x1875230420223488:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 129us (306us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359509.988299:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 112 00000100:00100000:0.0:1788359509.990697:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359509.990805:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223616 00000100:00100000:2.0:1788359509.990814:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223616 00000100:00100000:2.0:1788359509.990898:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:2.0:1788359509.990907:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+6:14921:x1875230420223616:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359509.990922:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359509.990939:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11b000/0x49dd053b5feaf9ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e723c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.990977:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11b000/0x49dd053b5feaf9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e723c expref: 7 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.990989:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11b000/0x49dd053b5feaf9ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e723c expref: 7 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359509.990998:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11b000, rc 0) 00000100:00100000:2.0:1788359509.991043:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+7:14921:x1875230420223616:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359509.991050:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 113 00000100:00100000:1.0:1788359509.996560:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359509.996729:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223744 00000100:00100000:3.0:1788359509.996740:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223744 00000100:00100000:3.0:1788359509.996805:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00100000:3.0:1788359509.996815:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+7:14921:x1875230420223744:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788359509.997038:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14921:x1875230420223744:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 223us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359509.997046:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 114 00000100:00100000:1.0:1788359509.999536:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359509.999700:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420223872 00000100:00100000:2.0:1788359509.999710:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420223872 00000100:00100000:2.0:1788359509.999773:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 115 00000100:00100000:2.0:1788359509.999783:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14921:x1875230420223872:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788359509.999952:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14921:x1875230420223872:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 169us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359509.999971:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 115 00000100:00100000:1.0:1788359510.003488:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.005036:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224000 00000100:00100000:0.0:1788359510.005048:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224000 00000100:00100000:0.0:1788359510.008057:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 116 00000100:00100000:0.0:1788359510.008078:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224000:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359510.008228:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224000:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 157us (4747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.008236:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 116 00000100:00100000:1.0:1788359510.029134:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.029200:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224128 00000100:00100000:2.0:1788359510.029211:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224128 00000100:00100000:2.0:1788359510.029367:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 117 00000100:00100000:2.0:1788359510.029379:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224128:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359510.029699:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224128:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 321us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.029708:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 117 00000100:00100000:1.0:1788359510.036263:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.036417:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224256 00000100:00100000:0.0:1788359510.036427:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224256 00000100:00100000:0.0:1788359510.036617:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 118 00000100:00100000:0.0:1788359510.036625:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224256:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359510.036751:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14939:x1875230420224256:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 127us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.036756:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 118 00000100:00100000:1.0:1788359510.038825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.038933:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224384 00000100:00100000:2.0:1788359510.038941:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224384 00000100:00100000:2.0:1788359510.039052:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 119 00000100:00100000:2.0:1788359510.039062:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+8:14921:x1875230420224384:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359510.039077:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359510.039094:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11ba00/0x49dd053b5feaf9d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e726d expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.039120:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11ba00/0x49dd053b5feaf9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e726d expref: 9 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.039131:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11ba00/0x49dd053b5feaf9d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e726d expref: 9 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.039142:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11ba00, rc 0) 00000100:00100000:2.0:1788359510.039191:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+9:14921:x1875230420224384:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 130us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.039199:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 119 00000100:00100000:1.0:1788359510.042029:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.042115:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224512 00000100:00100000:0.0:1788359510.042123:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224512 00000100:00100000:0.0:1788359510.042160:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 120 00000100:00100000:0.0:1788359510.042168:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+9:14921:x1875230420224512:12345-192.168.202.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788359510.042195:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788359510.042206:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788359510.042209:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788359510.042211:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788359510.042213:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788359510.042464:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788359510.044225:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+9:14921:x1875230420224512:12345-192.168.202.52@tcp:256:mount.lustre.0 Request processed in 2043us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.044236:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 120 00000100:00100000:1.0:1788359510.047064:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.047162:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224640 00000100:00100000:2.0:1788359510.047172:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224640 00000100:00100000:2.0:1788359510.047278:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00100000:2.0:1788359510.047289:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+9:14921:x1875230420224640:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359510.047307:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359510.047324:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7274 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.047354:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 10 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.047366:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 10 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359510.047375:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11aa00, rc 0) 00000100:00100000:2.0:1788359510.047441:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14921:x1875230420224640:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 153us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.047448:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 121 00000100:00100000:1.0:1788359510.052196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.052298:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224768 00000100:00100000:0.0:1788359510.052308:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224768 00000100:00100000:0.0:1788359510.052365:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00100000:0.0:1788359510.052375:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14921:x1875230420224768:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788359510.053055:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14921:x1875230420224768:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 678us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.053065:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 122 00000100:00100000:3.0:1788359510.055944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.056046:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420224896 00000100:00100000:2.0:1788359510.056056:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420224896 00000100:00100000:2.0:1788359510.056155:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 123 00000100:00100000:2.0:1788359510.056166:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14921:x1875230420224896:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788359510.056312:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14921:x1875230420224896:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 147us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.056319:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 123 00000100:00100000:1.0:1788359510.059234:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.059644:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225024 00000100:00100000:0.0:1788359510.059654:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225024 00000100:00100000:0.0:1788359510.059736:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 124 00000100:00100000:0.0:1788359510.059745:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14944:x1875230420225024:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359510.059905:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14944:x1875230420225024:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 161us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.059912:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 124 00000100:00100000:3.0:1788359510.064243:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.064321:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225152 00000100:00100000:2.0:1788359510.064330:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225152 00000100:00100000:2.0:1788359510.064426:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 125 00000100:00100000:2.0:1788359510.064435:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14944:x1875230420225152:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359510.064612:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:14944:x1875230420225152:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 176us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.064619:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 125 00000100:00100000:3.0:1788359510.074242:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359510.074336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.074440:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225280 00000100:00100000:0.0:1788359510.074451:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225280 00000100:00100000:0.0:1788359510.074491:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225536 00000100:00100000:0.0:1788359510.074548:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225536 00000100:00100000:0.0:1788359510.074575:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:0.0:1788359510.074583:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2401:x1875230420225280:12345-192.168.202.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788359510.074614:0:17190:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 74da3620-4733-4f31-913b-e0b808f61386@192.168.202.52@tcp t0 exp 0000000000000000 cur 542 last 0 00000100:00100000:1.0:1788359510.074653:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:1.0:1788359510.074660:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875230420225536:12345-192.168.202.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788359510.074680:0:17191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 74da3620-4733-4f31-913b-e0b808f61386@192.168.202.52@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788359510.074685:0:17190:0:(genops.c:1406:class_connect()) connect: client 74da3620-4733-4f31-913b-e0b808f61386, cookie 0x49dd053b5feaf9df 00000020:00000080:1.0:1788359510.074713:0:17191:0:(genops.c:1406:class_connect()) connect: client 74da3620-4733-4f31-913b-e0b808f61386, cookie 0x49dd053b5feaf9e6 00000004:00100000:0.0:1788359510.074715:0:17190:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:1.0:1788359510.074730:0:17191:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788359510.074998:0:17190:0:(import.c:65:import_set_state_nolock()) ffffa0eaf95ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788359510.075068:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:2401:x1875230420225280:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 484us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.075077:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00080000:1.0:1788359510.075079:0:17191:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6921000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359510.075111:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:2401:x1875230420225536:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 449us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359510.075118:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:0.0:1788359510.078622:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.078665:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359510.078724:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225664 00000100:00100000:1.0:1788359510.078734:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225664 00000100:00100000:2.0:1788359510.078748:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225408 00000100:00100000:2.0:1788359510.078754:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225408 00000100:00080000:0.0:1788359510.078818:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788359510.078823:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788359510.078888:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:1.0:1788359510.078900:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:0:x1875230420225664:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788359510.078936:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788359510.079045:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:0:x1875230420225664:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 147us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359510.079052:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:2.0:1788359510.079825:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359510.079836:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:0:x1875230420225408:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788359510.079860:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788359510.079914:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:0:x1875230420225408:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 81us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.079921:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:0.0:1788359510.082438:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359510.082678:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225792 00000100:00100000:3.0:1788359510.082687:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225792 00000100:00100000:3.0:1788359510.082753:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:3.0:1788359510.082763:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420225792:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788359510.082791:0:17189:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788359510.082865:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420225792:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 104us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359510.082873:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:0.0:1788359510.088002:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359510.089226:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420225920 00000100:00100000:1.0:1788359510.089237:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420225920 00000100:00100000:1.0:1788359510.089298:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:1.0:1788359510.089309:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420225920:12345-192.168.202.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788359510.089460:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420225920:12345-192.168.202.52@tcp:40:mount.lustre.0 Request processed in 153us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359510.089468:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:0.0:1788359510.091681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.091732:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359510.091810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359510.092236:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226304 00000100:00100000:2.0:1788359510.092245:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226304 00000100:00100000:2.0:1788359510.092299:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:2.0:1788359510.092310:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420226304:12345-192.168.202.52@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788359510.092392:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420226304:12345-192.168.202.52@tcp:900:mount.lustre.0 Request processed in 83us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359510.092403:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:3.0:1788359510.093004:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226048 00000100:00100000:1.0:1788359510.093005:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226176 00000100:00100000:3.0:1788359510.093011:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226048 00000100:00100000:1.0:1788359510.093012:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226176 00000100:00100000:3.0:1788359510.093095:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:3.0:1788359510.093101:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420226048:12345-192.168.202.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788359510.093128:0:18695:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 74da3620-4733-4f31-913b-e0b808f61386@192.168.202.52@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788359510.093161:0:18695:0:(genops.c:1406:class_connect()) connect: client 74da3620-4733-4f31-913b-e0b808f61386, cookie 0x49dd053b5feaf9ed 00002000:00100000:3.0:1788359510.093172:0:18695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74da3620-4733-4f31-913b-e0b808f61386/ffffa0e9c698e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788359510.093183:0:18695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788359510.093365:0:18695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788359510.093392:0:18695:0:(import.c:65:import_set_state_nolock()) ffffa0e9c698b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359510.093431:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74da3620-4733-4f31-913b-e0b808f61386+6:2401:x1875230420226048:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 323us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359510.093438:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:3.0:1788359510.093453:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:3.0:1788359510.093457:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1875230420226176:12345-192.168.202.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788359510.093474:0:18695:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 74da3620-4733-4f31-913b-e0b808f61386@192.168.202.52@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:3.0:1788359510.093488:0:18695:0:(genops.c:1406:class_connect()) connect: client 74da3620-4733-4f31-913b-e0b808f61386, cookie 0x49dd053b5feaf9f4 00002000:00100000:3.0:1788359510.093516:0:18695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74da3620-4733-4f31-913b-e0b808f61386/ffffa0e9c698e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788359510.093529:0:18695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788359510.093655:0:18695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788359510.093670:0:18695:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6989800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788359510.093707:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74da3620-4733-4f31-913b-e0b808f61386+6:2401:x1875230420226176:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 248us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359510.093714:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00000001:00100000:3.0:1788359510.096120:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74da3620-4733-4f31-913b-e0b808f61386 00000100:00100000:0.0:1788359510.098199:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359510.098304:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226432 00000100:00100000:1.0:1788359510.098311:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226432 00000100:00100000:1.0:1788359510.099113:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:1.0:1788359510.099125:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420226432:12345-192.168.202.52@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788359510.100014:0:17193:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 814us 00000004:00200000:0.0:1788359510.108787:0:17193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788359510.108920:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+6:14921:x1875230420226432:12345-192.168.202.52@tcp:33:mount.lustre.0 Request processed in 9792us (10721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359510.108934:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:0.0:1788359510.204962:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788359510.204987:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445460096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359510.205070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359510.206392:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460096 00000100:00100000:1.0:1788359510.206401:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460096 00000100:00100000:1.0:1788359510.206454:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788359510.206463:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445460096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788359510.206492:0:17929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788359510.206586:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445460096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359510.206593:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359510.206688:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445460096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359510.210831:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359510.211044:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226560 00000100:00100000:3.0:1788359510.211054:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226560 00000100:00100000:3.0:1788359510.211126:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:3.0:1788359510.211137:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+6:14967:x1875230420226560:12345-192.168.202.52@tcp:101:mkdir.0 00010000:00010000:3.0:1788359510.211158:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359510.211183:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e72a5 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211238:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211250:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211260:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359510.211301:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359510.211304:0:17189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359510.211348:0:17189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211367:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feaf9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72a5 expref: 8 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211381:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72a5 expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359510.211392:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:3.0:1788359510.211394:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359510.211396:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad6000, rc 0) 00000100:00100000:3.0:1788359510.211445:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+7:14967:x1875230420226560:12345-192.168.202.52@tcp:101:mkdir.0 Request processed in 311us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359510.211452:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00010000:00010000:0.0:1788359510.908998:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788359511.233653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359511.233660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788359511.233663:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359511.233675:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0eb0068a800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359511.233698:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74fce00 x1875230445460608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788359511.233747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788359511.233751:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788359511.233753:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788359511.233757:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffffa0eac4a8e800 using connection 192.168.202.152@tcp/0@lo 00000100:00100000:2.0:1788359511.233768:0:37:0:(import.c:832:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0e9c74ff480 x1875230445461120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788359511.233828:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445460352:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.233893:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.233955:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445460992:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.233979:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.233996:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445461632:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.234045:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788359511.234050:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445460480:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.234086:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445461248:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.234119:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445461760:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.234172:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460352 00000100:00100000:2.0:1788359511.234178:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460352 00000100:00100000:2.0:1788359511.234220:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359511.234229:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445460352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234279:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445460352:12345-0@lo:400:kworker.0 Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234292:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359511.234314:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460992 00000100:00100000:2.0:1788359511.234317:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460992 00000100:00100000:2.0:1788359511.234351:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460480 00000100:00100000:2.0:1788359511.234353:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460480 00000100:00100000:2.0:1788359511.234372:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359511.234377:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234407:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445460992:12345-0@lo:400:kworker.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234412:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788359511.234487:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359511.234519:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445460480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234551:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445460480:12345-0@lo:400:kworker.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234557:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788359511.234592:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445460480:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234603:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445460352:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234612:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445460992:0@lo:400:kworker.0 00000100:00080000:2.0:1788359511.234637:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359511.234649:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461632 00000100:00100000:2.0:1788359511.234652:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461632 00000100:00100000:2.0:1788359511.234684:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461248 00000100:00100000:2.0:1788359511.234687:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461248 00000100:00100000:2.0:1788359511.234697:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461760 00000100:00100000:2.0:1788359511.234699:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461760 00000100:00100000:2.0:1788359511.234713:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359511.234727:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445461632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234764:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875230445461632:12345-0@lo:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234770:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788359511.234783:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359511.234789:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445461248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234816:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445461248:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234822:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788359511.234832:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359511.234838:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445461760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.234881:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445461760:12345-0@lo:400:kworker.0 Request processed in 43us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.234887:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788359511.234914:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445461248:0@lo:400:kworker.0 00010000:00080000:2.0:1788359511.234926:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead28ded80 x1875230445461760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359511.234936:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445461760:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235034:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235068:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235088:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445461376:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235123:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788359511.235128:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445460224:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235152:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235173:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445460864:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235213:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445461504:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235252:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445460608:0@lo:8:kworker.0 00000100:00100000:1.0:1788359511.235285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235303:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445461120:0@lo:8:kworker.0 00000100:00100000:1.0:1788359511.235321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.235346:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460736 00000100:00100000:1.0:1788359511.235350:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460736 00000100:00100000:1.0:1788359511.235370:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461376 00000100:00100000:1.0:1788359511.235373:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461376 00000100:00100000:1.0:1788359511.235385:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461504 00000100:00100000:1.0:1788359511.235388:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461504 00000100:00100000:1.0:1788359511.235400:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359511.235407:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445460736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235458:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875230445460736:12345-0@lo:400:kworker.0 Request processed in 51us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.235464:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788359511.235477:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359511.235483:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead2751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445461376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235534:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead2751180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875230445461376:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.235540:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788359511.235552:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359511.235558:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445461504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235582:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445461504:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.235588:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788359511.235605:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460864 00000100:00100000:1.0:1788359511.235608:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460864 00000100:00100000:1.0:1788359511.235629:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788359511.235642:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445460864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.235673:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445460864:12345-0@lo:400:kworker.0 Request processed in 32us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.235679:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788359511.235698:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460608 00000100:00100000:1.0:1788359511.235701:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460608 00000100:00100000:1.0:1788359511.235716:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461120 00000100:00100000:1.0:1788359511.235719:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461120 00000100:00100000:1.0:1788359511.235727:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788359511.235732:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445460608:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788359511.235758:0:18696:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1788359511.235786:0:18696:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x49dd053b5feafa09 00002000:00100000:1.0:1788359511.235799:0:18696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0e9c6916000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788359511.235803:0:18696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788359511.235806:0:18696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788359511.235983:0:18696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788359511.236003:0:18696:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6913800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359511.236040:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1875230445460608:12345-0@lo:8:kworker.0 Request processed in 307us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.236046:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788359511.236058:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788359511.236062:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3641:x1875230445461120:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788359511.236076:0:18696:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1788359511.236091:0:18696:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x49dd053b5feafa10 00002000:00100000:1.0:1788359511.236097:0:18696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffffa0e9c6916800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113801 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788359511.236100:0:18696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788359511.236107:0:18696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788359511.236131:0:18696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788359511.236142:0:18696:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6913000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359511.236169:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1875230445461120:12345-0@lo:8:kworker.0 Request processed in 105us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.236175:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788359511.236203:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74fce00 x1875230445460608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359511.236217:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788359511.236224:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788359511.236228:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788359511.236230:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eb0068a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788359511.236254:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788359511.236260:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3641:1875230445460608:0@lo:8:kworker.0 00010000:00080000:1.0:1788359511.236273:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c74ff480 x1875230445461120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788359536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788359511.236282:0:3641:0:(import.c:1138:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788359511.236287:0:3641:0:(import.c:962:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788359511.236289:0:3641:0:(import.c:1219:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788359511.236292:0:3641:0:(import.c:65:import_set_state_nolock()) ffffa0eac4a8e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788359511.236301:0:3641:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788359511.236304:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3641:1875230445461120:0@lo:8:kworker.0 00000004:00080000:1.0:1788359511.236347:0:17215:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788359511.236408:0:17215:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 543206912061ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788359511.236414:0:17215:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788359511.236627:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445460864:0@lo:400:kworker.0 00010000:00080000:1.0:1788359511.236639:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0ead28de680 x1875230445461504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359511.236655:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445461504:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.236669:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875230445460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788359511.236679:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3644:1875230445461376:0@lo:400:kworker.0 00000100:00100000:2.0:1788359511.238036:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead28df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3642:1875230445461632:0@lo:400:kworker.0 00000100:00080000:2.0:1788359511.238090:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359511.238096:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788359511.238172:0:17216:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788359511.238194:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17216:1875230445462016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788359511.238252:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.238290:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788359511.238308:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462016 00000100:00100000:2.0:1788359511.238314:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462016 00000100:00100000:2.0:1788359511.238360:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359511.238369:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17216:x1875230445462016:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788359511.238604:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788359511.238851:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445461888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788359511.238885:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.238919:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445461888 00000100:00100000:1.0:1788359511.238924:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445461888 00000100:00100000:1.0:1788359511.238961:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788359511.238968:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445461888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359511.238982:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788359511.239024:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1875230445461888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.239031:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788359511.239067:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac5500 x1875230445461888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359511.239085:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445461888:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788359511.239211:0:17933:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788359511.239229:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462272:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788359511.239256:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359511.239276:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000004:00080000:0.0:1788359511.239290:0:17932:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788359511.239367:0:17932:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 543209871231ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788359511.239372:0:17932:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788359511.239535:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462272 00000100:00100000:0.0:1788359511.239540:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462272 00000100:00100000:0.0:1788359511.239580:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788359511.239587:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17933:x1875230445462272:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788359511.239655:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788359511.239749:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359511.239759:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445462144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359511.239789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359511.239816:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462144 00000100:00100000:0.0:1788359511.239819:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462144 00000100:00100000:0.0:1788359511.239842:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788359511.239848:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875230445462144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359511.239859:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8717760 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788359511.239893:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1875230445462144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359511.239900:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788359511.239929:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb64e00 x1875230445462144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788359527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359511.239961:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445462144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359511.240088:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445460224 00000100:00100000:0.0:1788359511.240093:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445460224 00000100:00100000:0.0:1788359511.240118:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788359511.240125:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3644:x1875230445460224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788359511.240161:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf366ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3644:x1875230445460224:12345-0@lo:400:kworker.0 Request processed in 36us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359511.240167:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788359511.240199:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445460224:0@lo:400:kworker.0 00000004:00080000:2.0:1788359511.241575:0:17921:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000001:00100000:2.0:1788359511.241595:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74da3620-4733-4f31-913b-e0b808f61386 00000004:00080000:2.0:1788359511.245857:0:17169:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:2.0:1788359511.245879:0:17169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74da3620-4733-4f31-913b-e0b808f61386 00002000:00080000:3.0:1788359511.250986:0:18696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788359511.250997:0:18696:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788359511.251003:0:18696:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00080000:0.0:1788359511.251220:0:18695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788359511.251225:0:18695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788359511.251323:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17933:x1875230445462272:12345-0@lo:7:osp-pre-1-1.0 Request processed in 11733us (12062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359511.251335:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788359511.251592:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb67b80 x1875230445462272/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788359527 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788359511.251608:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb67b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462272:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788359511.251623:0:17933:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788359511.251662:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462400:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788359511.251695:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359511.251737:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac4f94300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359511.251808:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462400 00000100:00100000:2.0:1788359511.251815:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462400 00000100:00100000:2.0:1788359511.251862:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788359511.251870:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17933:x1875230445462400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788359511.251894:0:18796:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788359511.251937:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17933:x1875230445462400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.251953:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788359511.252012:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c80ee300 x1875230445462400/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788359527 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788359511.252022:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462400:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788359511.252029:0:17933:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788359511.252054:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462528:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788359511.252077:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359511.252099:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359511.252147:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462528 00000100:00100000:2.0:1788359511.252151:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462528 00000100:00100000:2.0:1788359511.252179:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788359511.252185:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17933:x1875230445462528:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788359511.252208:0:18793:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:3.0:1788359511.263104:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788359511.263114:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.263139:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788359511.263144:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359511.263151:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.263169:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.263178:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.263183:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.263215:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359511.263246:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.263256:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.263266:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.263271:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.263280:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.263300:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.263309:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000157355d4/0x49dd053b5feafa17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.263332:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.263334:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.263336:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788359511.264077:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.264085:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264099:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.264103:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.264107:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264118:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264138:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264145:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264204:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788359511.264476:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.264482:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264491:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.264531:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.264536:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264547:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264566:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.264571:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264717:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359511.264722:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264728:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.264731:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264745:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264755:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264760:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4baf310/0x49dd053b5feafa1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264770:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.264772:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264776:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.264778:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264782:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264787:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.264790:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.264792:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.264796:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.264837:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788359511.264841:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85ea737/0x49dd053b5feafa25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359511.265274:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.265280:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265289:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.265292:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.265296:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265307:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265315:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265334:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265367:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.265372:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265380:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.265383:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265391:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265403:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265410:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.265412:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.265413:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.265469:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788359511.265474:0:18696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000144514a2/0x49dd053b5feafa2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.265694:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788359511.265925:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.265931:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265940:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.265954:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.265959:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265968:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265976:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.265983:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266011:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359511.266183:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.266188:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266195:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.266199:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266207:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266225:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266233:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051efe4aa/0x49dd053b5feafa33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266247:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.266249:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.266251:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788359511.266736:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.266742:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266752:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.266756:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.266760:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266770:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266778:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266786:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.266803:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359511.266915:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.266920:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266927:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.266931:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266938:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266962:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266970:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b463e71e/0x49dd053b5feafa3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.266995:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.266997:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.266999:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788359511.267179:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.267185:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267193:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.267202:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.267207:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267217:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267225:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267233:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267284:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359511.267432:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.267437:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788359511.267602:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.267607:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267615:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.267617:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.267621:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267629:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267637:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267649:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267664:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788359511.267974:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.267980:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.267990:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.267993:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.267997:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.268007:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.268015:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.268022:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.268030:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788359511.268244:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1788359511.270017:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788359511.270029:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788359511.270040:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788359511.270042:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788359511.270047:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788359511.270051:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788359511.270057:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1788359511.270063:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788359511.270070:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788359511.270071:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788359511.270074:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74da3620-4733-4f31-913b-e0b808f61386 00010000:00010000:3.0:1788359511.270078:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270087:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788359511.270617:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.270622:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270628:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788359511.270631:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270636:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270642:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.270650:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270651:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270658:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bae313/0x49dd053b5feafa41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270660:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270669:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.270676:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002682b73f/0x49dd053b5feafa48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270677:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.270681:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270686:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.270688:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.270689:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.270691:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.270693:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270702:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270713:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270720:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcd451bb/0x49dd053b5feafa56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.270733:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.270734:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.270736:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788359511.270858:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788359511.270865:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.270873:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=543s v=(0 0) 00010000:00010000:0.0:1788359511.270877:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359511.270881:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.270890:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.270897:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.270904:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.270936:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788359511.271015:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.271019:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271026:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9c00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.271030:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271037:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271049:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271062:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000759712ab/0x49dd053b5feafa5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271075:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.271077:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.271079:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.271283:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.271286:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.271288:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.271318:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.271327:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.271330:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359511.271332:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.271337:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.271339:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271346:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788359511.271349:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271349:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.271353:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271362:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.271367:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c93ccb3/0x49dd053b5feafa4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271370:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271377:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.271381:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.271382:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.271384:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.271396:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:1.0:1788359511.271813:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.271824:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271833:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.271836:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.271841:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271850:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271859:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.271865:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359511.272659:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17933:x1875230445462528:12345-0@lo:5:osp-pre-1-1.0 Request processed in 20468us (20575us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788359511.272669:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788359511.272718:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.272726:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272729:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788359511.272733:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.272735:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180c00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.272739:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272741:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:1.0:1788359511.272744:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.272748:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272751:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.272762:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272767:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.272770:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000067c5807/0x49dd053b5feafa64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272775:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006a68d45/0x49dd053b5feafa6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.272789:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.272791:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.272793:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359511.272857:0:17933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788359511.272864:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17933:1875230445462528:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788359511.272879:0:17933:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788359511.272931:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17933:1875230445462656:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788359511.272979:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359511.273007:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd8f1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788359511.273034:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462656 00000100:00100000:3.0:1788359511.273040:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462656 00000100:00100000:3.0:1788359511.273083:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359511.273093:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1875230445462656:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788359511.273139:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1875230445462656:12345-0@lo:900:osp-pre-1-1.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359511.273145:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788359511.273174:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17933:1875230445462656:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1788359511.273204:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.273206:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.273208:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.273341:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.273348:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273357:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.273361:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.273366:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273376:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273385:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273392:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273462:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788359511.273767:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.273773:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273781:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.273784:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.273788:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273799:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273806:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273813:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.273839:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788359511.274150:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.274156:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274165:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.274173:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.274178:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274188:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274196:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274203:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274215:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788359511.274293:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788359511.274300:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274308:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.274311:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274320:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274334:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274348:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4cf0a5f/0x49dd053b5feafa72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274366:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788359511.274369:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274375:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.274378:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274386:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274395:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274401:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0d5b398/0x49dd053b5feafa79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274412:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.274414:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274420:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.274430:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274437:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274445:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274452:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099ee7e64/0x49dd053b5feafa80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274465:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.274467:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.274468:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.274474:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.274691:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.274826:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.274831:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274836:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.274838:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.274841:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274847:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274851:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274861:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.274872:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.274895:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.274899:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274906:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.274909:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274916:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274927:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274938:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014c9b979/0x49dd053b5feafa87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.274965:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.274967:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.274969:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.275244:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.275249:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275257:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.275260:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.275264:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275274:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275281:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275288:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275310:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.275325:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.275329:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.275337:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180200 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.275340:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.275348:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.275359:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.275366:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6633860/0x49dd053b5feafa8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.275379:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.275381:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.275383:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.275891:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.275896:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275909:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.275911:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.275914:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275920:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275925:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275930:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.275950:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788359511.275970:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788359511.275976:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.275993:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:0.0:1788359511.275996:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.276003:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.276014:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.276022:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d92ab8/0x49dd053b5feafa95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359511.276037:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.276038:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788359511.276040:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.276275:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.276279:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276285:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.276286:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.276289:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276295:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276308:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276312:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276324:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.276346:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.276351:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276358:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.276362:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276369:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276380:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276387:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000527355cf/0x49dd053b5feafa9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276402:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.276404:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.276406:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.276585:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.276590:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276598:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.276601:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.276605:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276613:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276620:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276627:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276652:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.276868:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.276873:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276881:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180000 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.276884:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359511.276884:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.276889:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276896:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=543s v=(0 0) 00010000:00010000:3.0:1788359511.276903:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276908:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.276912:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276914:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276922:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009314fe07/0x49dd053b5feafaa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276922:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.276930:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276937:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.276937:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276938:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.276940:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788359511.276962:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.276968:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.276971:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276978:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.276982:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276990:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.276999:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277015:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067a970f4/0x49dd053b5feafaaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277032:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.277034:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.277036:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359511.277189:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.277259:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.277264:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277272:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.277280:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.277285:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277293:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277302:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277309:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277329:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.277556:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.277561:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277569:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.277573:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277581:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277592:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277600:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b085b65/0x49dd053b5feafab1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277614:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.277616:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.277617:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.277840:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.277846:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277854:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.277858:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.277861:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277870:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277878:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277891:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.277910:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.277972:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.277977:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277984:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181800 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.277988:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.277996:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278006:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278013:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7b8a7a/0x49dd053b5feafab8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278028:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.278030:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.278031:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.278200:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.278205:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278213:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.278216:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.278220:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278228:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278235:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278243:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278263:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.278563:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.278569:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278577:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180e00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.278580:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278594:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278601:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278606:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034b72e89/0x49dd053b5feafabf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.278617:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.278618:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.278619:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.278754:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.278759:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278772:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.278775:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.278779:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278789:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278797:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278804:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.278823:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788359511.278917:0:19981:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359511.278925:0:19981:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.278930:0:19981:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359511.278932:0:19981:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.278937:0:19981:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.278960:0:19981:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.278968:0:19981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004916a089/0x49dd053b5feafac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.278982:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359511.278984:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359511.278986:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.279091:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.279095:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.279100:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.279102:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.279105:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.279110:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.279123:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.279131:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.279148:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.279248:0:17178:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.279253:0:17178:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.279261:0:17178:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eba00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:3.0:1788359511.279264:0:17178:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.279271:0:17178:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.279282:0:17178:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.279300:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafacd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.279312:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.279313:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.279314:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788359511.280294:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788359511.280301:0:18696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.280309:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788359511.280312:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359511.280315:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.280321:0:18696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.280327:0:18696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.280332:0:18696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359511.280354:0:18696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788359511.280378:0:19980:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788359511.280383:0:19980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.280391:0:19980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea800 already unused, calling callback (ffffffffc0b29300) 00002000:00080000:1.0:1788359511.280393:0:18696:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:3.0:1788359511.280394:0:19980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.280402:0:19980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.280412:0:19980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.280418:0:19980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c92b4930/0x49dd053b5feafad4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359511.280430:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.280432:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788359511.280433:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359511.280488:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17216:x1875230445462016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 42119us (42234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.280518:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788359511.280656:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17216:1875230445462016:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788359511.280670:0:17216:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1788359511.280708:0:17216:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17216:1875230445462784:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788359511.280736:0:17216:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359511.280763:0:17216:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eae552a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359511.280774:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462784 00000100:00100000:0.0:1788359511.280781:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462784 00000100:00100000:0.0:1788359511.280823:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788359511.280831:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17216:x1875230445462784:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788359511.280869:0:18796:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788359511.284082:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17216:x1875230445462784:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3246us (3338us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788359511.284095:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788359511.284170:0:17216:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17216:1875230445462784:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788359511.284185:0:17216:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:2.0:1788359511.855431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359511.855553:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226688 00000100:00100000:1.0:1788359511.855566:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226688 00000100:00100000:1.0:1788359511.855670:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:1.0:1788359511.855680:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:15020:x1875230420226688:12345-192.168.202.52@tcp:41:lfs.0 00000004:00000024:1.0:1788359511.855719:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788359511.855825:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+6:15020:x1875230420226688:12345-192.168.202.52@tcp:41:lfs.0 Request processed in 144us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.855833:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:0.0:1788359511.860825:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359511.860882:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226816 00000100:00100000:1.0:1788359511.860890:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226816 00000100:00100000:1.0:1788359511.860956:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:1.0:1788359511.860966:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420226816:12345-192.168.202.52@tcp:41:lfs.0 00000004:00000024:1.0:1788359511.861005:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788359511.861095:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420226816:12345-192.168.202.52@tcp:41:lfs.0 Request processed in 131us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.861103:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:0.0:1788359511.865741:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359511.865840:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420226944 00000100:00100000:1.0:1788359511.865850:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420226944 00000100:00100000:1.0:1788359511.865987:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359511.865998:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420226944:12345-192.168.202.52@tcp:13:lfs.0 00002000:00000024:1.0:1788359511.866061:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788359511.866141:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420226944:12345-192.168.202.52@tcp:13:lfs.0 Request processed in 144us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.866148:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00080000:0.0:1788359511.866471:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788359511.868607:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359511.870172:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227072 00000100:00100000:1.0:1788359511.870197:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227072 00000100:00100000:1.0:1788359511.870292:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:1.0:1788359511.870302:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420227072:12345-192.168.202.52@tcp:13:lfs.0 00002000:00000024:1.0:1788359511.870329:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788359511.870408:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74da3620-4733-4f31-913b-e0b808f61386+5:15020:x1875230420227072:12345-192.168.202.52@tcp:13:lfs.0 Request processed in 107us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.870417:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00080000:0.0:1788359511.870576:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788359511.932778:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359511.974367:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359511.974638:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227200 00000100:00100000:2.0:1788359511.974655:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227200 00000100:00100000:2.0:1788359511.974728:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 127 00000100:00100000:2.0:1788359511.974740:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf3669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+10:15052:x1875230420227200:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359511.974755:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359511.974772:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11a600/0x49dd053b5feafadb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e72ac expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.974801:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11a600/0x49dd053b5feafadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72ac expref: 11 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.974813:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11a600/0x49dd053b5feafadb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72ac expref: 11 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359511.974823:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11a600, rc 0) 00000100:00100000:2.0:1788359511.974897:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf3669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227200:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 158us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359511.974903:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 127 00000100:00100000:2.0:1788359511.977827:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359511.977958:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227328 00000100:00100000:1.0:1788359511.977966:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227328 00000100:00100000:1.0:1788359511.978032:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 128 00000100:00100000:1.0:1788359511.978039:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227328:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788359511.978414:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227328:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 375us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359511.978420:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 128 00000100:00100000:1.0:1788359511.988035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359511.988217:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227456 00000100:00100000:0.0:1788359511.988233:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227456 00000100:00100000:0.0:1788359511.988313:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:0.0:1788359511.988322:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227456:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788359511.988475:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227456:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 153us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359511.988483:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 129 00000100:00100000:3.0:1788359511.998691:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359512.000007:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227584 00000100:00100000:1.0:1788359512.000023:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227584 00000100:00100000:1.0:1788359512.000123:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00100000:1.0:1788359512.000134:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227584:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788359512.000361:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227584:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 228us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359512.000377:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 130 00000100:00100000:1.0:1788359512.028360:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.028442:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227712 00000100:00100000:2.0:1788359512.028452:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227712 00000100:00100000:2.0:1788359512.028528:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 131 00000100:00100000:2.0:1788359512.028540:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227712:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788359512.028694:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227712:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359512.028702:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 131 00000100:00100000:2.0:1788359512.033245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.036217:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227840 00000100:00100000:0.0:1788359512.036237:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227840 00000100:00100000:0.0:1788359512.036332:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 132 00000100:00100000:0.0:1788359512.036344:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227840:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359512.036587:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15059:x1875230420227840:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 245us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.036597:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 132 00000100:00100000:3.0:1788359512.044057:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.044727:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420227968 00000100:00100000:2.0:1788359512.044742:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420227968 00000100:00100000:2.0:1788359512.044874:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 133 00000100:00100000:2.0:1788359512.044887:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:15052:x1875230420227968:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359512.044909:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359512.044933:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11a000/0x49dd053b5feafae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e72dd expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.044982:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11a000/0x49dd053b5feafae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72dd expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.044994:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11a000/0x49dd053b5feafae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72dd expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.045006:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11a000, rc 0) 00000100:00100000:2.0:1788359512.045094:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:15052:x1875230420227968:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 209us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359512.045102:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 133 00000100:00100000:1.0:1788359512.050705:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.050900:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228096 00000100:00100000:0.0:1788359512.050914:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228096 00000100:00100000:0.0:1788359512.050994:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 134 00000100:00100000:0.0:1788359512.051006:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:15052:x1875230420228096:12345-192.168.202.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788359512.051042:0:17184:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788359512.051075:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788359512.051080:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788359512.051084:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788359512.051087:0:17184:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788359512.051095:0:17184:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788359512.053405:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:15052:x1875230420228096:12345-192.168.202.52@tcp:256:mount.lustre.0 Request processed in 2385us (2699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.053427:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 134 00000100:00100000:3.0:1788359512.056258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.056383:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228224 00000100:00100000:2.0:1788359512.056395:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228224 00000100:00100000:2.0:1788359512.056463:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 135 00000100:00100000:2.0:1788359512.056474:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:15052:x1875230420228224:12345-192.168.202.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788359512.056526:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359512.056550:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e72e4 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.056588:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.056621:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359512.056632:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11bc00, rc 0) 00000100:00100000:2.0:1788359512.058018:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15052:x1875230420228224:12345-192.168.202.52@tcp:101:mount.lustre.0 Request processed in 1535us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359512.058030:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 135 00000100:00100000:1.0:1788359512.071087:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.071212:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228352 00000100:00100000:0.0:1788359512.071222:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228352 00000100:00100000:0.0:1788359512.071344:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 136 00000100:00100000:0.0:1788359512.071354:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15052:x1875230420228352:12345-192.168.202.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788359512.071527:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15052:x1875230420228352:12345-192.168.202.52@tcp:501:mount.lustre.0 Request processed in 175us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.071535:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 136 00000100:00100000:2.0:1788359512.074023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.074576:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228480 00000100:00100000:0.0:1788359512.074588:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228480 00000100:00100000:0.0:1788359512.074671:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:0.0:1788359512.074678:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15052:x1875230420228480:12345-192.168.202.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788359512.074803:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15052:x1875230420228480:12345-192.168.202.52@tcp:503:mount.lustre.0 Request processed in 125us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.074808:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 137 00000100:00100000:3.0:1788359512.079120:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.079386:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228608 00000100:00100000:0.0:1788359512.079398:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228608 00000100:00100000:0.0:1788359512.079472:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:0.0:1788359512.079483:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15064:x1875230420228608:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359512.079746:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eac2c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15064:x1875230420228608:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 264us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.079755:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 138 00000100:00100000:2.0:1788359512.086897:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359512.087020:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228736 00000100:00100000:0.0:1788359512.087035:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228736 00000100:00100000:0.0:1788359512.087108:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 139 00000100:00100000:0.0:1788359512.087118:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15064:x1875230420228736:12345-192.168.202.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788359512.087310:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:15064:x1875230420228736:12345-192.168.202.52@tcp:502:llog_process_th.0 Request processed in 192us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.087320:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 139 00000100:00100000:2.0:1788359512.095633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.095745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359512.095850:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228864 00000100:00100000:1.0:1788359512.095865:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228864 00000100:00100000:3.0:1788359512.095879:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229120 00000100:00100000:3.0:1788359512.095889:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229120 00000100:00100000:1.0:1788359512.095948:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:1.0:1788359512.095959:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1875230420228864:12345-192.168.202.52@tcp:38:mount.lustre.0 00000100:00100000:3.0:1788359512.095965:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:3.0:1788359512.095977:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1875230420229120:12345-192.168.202.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788359512.096004:0:17191:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from baeaa55a-ca44-4479-b153-533092acc688@192.168.202.52@tcp t0 exp 0000000000000000 cur 544 last 0 00010000:00080000:3.0:1788359512.096012:0:17189:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from baeaa55a-ca44-4479-b153-533092acc688@192.168.202.52@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788359512.096061:0:17189:0:(genops.c:1406:class_connect()) connect: client baeaa55a-ca44-4479-b153-533092acc688, cookie 0x49dd053b5feafaf7 00000020:00000080:1.0:1788359512.096075:0:17191:0:(genops.c:1406:class_connect()) connect: client baeaa55a-ca44-4479-b153-533092acc688, cookie 0x49dd053b5feafaf0 00000004:00100000:3.0:1788359512.096107:0:17189:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:1.0:1788359512.096107:0:17191:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788359512.096248:0:17189:0:(import.c:65:import_set_state_nolock()) ffffa0e9c698c800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788359512.096255:0:17191:0:(import.c:65:import_set_state_nolock()) ffffa0e9c6911800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788359512.096328:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baeaa55a-ca44-4479-b153-533092acc688+6:2401:x1875230420228864:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 369us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359512.096338:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:2.0:1788359512.097176:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+6:2401:x1875230420229120:12345-192.168.202.52@tcp:38:mount.lustre.0 Request processed in 1193us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359512.097187:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:2.0:1788359512.100317:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.100360:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.100393:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359512.100464:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229376 00000100:00100000:1.0:1788359512.100478:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229376 00000100:00100000:3.0:1788359512.100483:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420228992 00000100:00100000:3.0:1788359512.100532:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420228992 00000100:00100000:0.0:1788359512.100538:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229248 00000100:00100000:0.0:1788359512.100544:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229248 00000100:00080000:2.0:1788359512.100603:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359512.100612:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:1.0:1788359512.100627:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baeaa55a-ca44-4479-b153-533092acc688+7:15052:x1875230420229376:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788359512.100665:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788359512.100748:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:baeaa55a-ca44-4479-b153-533092acc688+7:15052:x1875230420229376:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 126us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359512.100879:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:3.0:1788359512.103613:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+7:0:x1875230420228992:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788359512.103676:0:17190:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788359512.103767:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+7:0:x1875230420228992:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 2877us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359512.103778:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:1.0:1788359512.103994:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:0.0:1788359512.104034:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:0.0:1788359512.104051:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baeaa55a-ca44-4479-b153-533092acc688+6:0:x1875230420229248:12345-192.168.202.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788359512.104078:0:18578:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788359512.104120:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baeaa55a-ca44-4479-b153-533092acc688+6:0:x1875230420229248:12345-192.168.202.52@tcp:41:mount.lustre.0 Request processed in 74us (3729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.104128:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00080000:2.0:1788359512.104463:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359512.106720:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359512.106835:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229504 00000100:00100000:3.0:1788359512.106844:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229504 00000100:00100000:3.0:1788359512.106907:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:3.0:1788359512.106918:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420229504:12345-192.168.202.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788359512.107030:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420229504:12345-192.168.202.52@tcp:40:mount.lustre.0 Request processed in 111us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359512.107038:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:3.0:1788359512.108595:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359512.108624:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359512.108646:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229632 00000100:00100000:1.0:1788359512.108655:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229632 00000100:00100000:3.0:1788359512.108656:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.108675:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229760 00000100:00100000:2.0:1788359512.108681:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229760 00000100:00100000:1.0:1788359512.108700:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:1.0:1788359512.108708:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1875230420229632:12345-192.168.202.52@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788359512.108715:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:2.0:1788359512.108723:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1875230420229760:12345-192.168.202.52@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788359512.108730:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420229888 00000100:00100000:0.0:1788359512.108736:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420229888 00010000:00080000:1.0:1788359512.108743:0:18697:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from baeaa55a-ca44-4479-b153-533092acc688@192.168.202.52@tcp t0 exp 0000000000000000 cur 544 last 0 00010000:00080000:2.0:1788359512.108748:0:18793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from baeaa55a-ca44-4479-b153-533092acc688@192.168.202.52@tcp t0 exp 0000000000000000 cur 544 last 0 00000100:00100000:0.0:1788359512.108779:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000020:00000080:2.0:1788359512.108782:0:18793:0:(genops.c:1406:class_connect()) connect: client baeaa55a-ca44-4479-b153-533092acc688, cookie 0x49dd053b5feafafe 00000020:00000080:1.0:1788359512.108782:0:18697:0:(genops.c:1406:class_connect()) connect: client baeaa55a-ca44-4479-b153-533092acc688, cookie 0x49dd053b5feafb05 00000100:00100000:0.0:1788359512.108788:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420229888:12345-192.168.202.52@tcp:900:mount.lustre.0 00002000:00100000:1.0:1788359512.108795:0:18697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli baeaa55a-ca44-4479-b153-533092acc688/ffffa0eafd8cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788359512.108797:0:18793:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli baeaa55a-ca44-4479-b153-533092acc688/ffffa0eafd8a0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113801 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788359512.108811:0:18793:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788359512.108811:0:18697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788359512.108848:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420229888:12345-192.168.202.52@tcp:900:mount.lustre.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359512.108855:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00002000:00080000:2.0:1788359512.108879:0:18793:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1788359512.108906:0:18697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788359512.108910:0:18793:0:(import.c:65:import_set_state_nolock()) ffffa0eafd8a7000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788359512.108928:0:18697:0:(import.c:65:import_set_state_nolock()) ffffa0eafd8ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788359512.108968:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:baeaa55a-ca44-4479-b153-533092acc688+6:2401:x1875230420229760:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 243us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359512.108976:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:baeaa55a-ca44-4479-b153-533092acc688+6:2401:x1875230420229632:12345-192.168.202.52@tcp:8:mount.lustre.0 Request processed in 266us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359512.108985:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:2.0:1788359512.108992:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:3.0:1788359512.110566:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359512.110634:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230016 00000100:00100000:2.0:1788359512.110641:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230016 00000100:00100000:2.0:1788359512.110670:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:2.0:1788359512.110678:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420230016:12345-192.168.202.52@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788359512.110757:0:17192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788359512.110816:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+6:15052:x1875230420230016:12345-192.168.202.52@tcp:33:mount.lustre.0 Request processed in 138us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359512.110823:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:3.0:1788359512.224965:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359512.225407:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230144 00000100:00100000:1.0:1788359512.225415:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230144 00000100:00100000:1.0:1788359512.225464:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 22 00000100:00100000:1.0:1788359512.225472:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+6:15087:x1875230420230144:12345-192.168.202.52@tcp:101:mkdir.0 00010000:00010000:1.0:1788359512.225672:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359512.225693:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feafb0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7315 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225745:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225755:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225764:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359512.225815:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788359512.225818:0:17189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788359512.225833:0:17189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225851:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eac00/0x49dd053b5feafb0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 8 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225867:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359512.225875:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:1.0:1788359512.225878:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788359512.225882:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75ea800, rc 0) 00000100:00100000:1.0:1788359512.225943:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+7:15087:x1875230420230144:12345-192.168.202.52@tcp:101:mkdir.0 Request processed in 461us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359512.225950:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 22 00000040:00080000:1.0:1788359512.254066:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788359512.764690:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359512.764714:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445462912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788359512.764778:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359512.764852:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445462912 00000100:00100000:3.0:1788359512.764861:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445462912 00000100:00100000:3.0:1788359512.764915:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788359512.764942:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445462912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788359512.764966:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788359512.765038:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445462912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359512.765046:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788359512.765114:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445462912:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788359512.965174:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359513.276841:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445463040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359513.276901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359513.277001:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463040 00000100:00100000:1.0:1788359513.277009:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463040 00000100:00100000:1.0:1788359513.277058:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788359513.277065:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445463040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788359513.277091:0:17194:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788359513.277136:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445463040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359513.277144:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788359513.277214:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445463040:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788359513.674415:0:20066:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788359513.980706:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359514.812682:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445463168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359514.812761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359514.812803:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463168 00000100:00100000:1.0:1788359514.812824:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463168 00000100:00080000:2.0:1788359514.812883:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788359514.812923:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788359514.812934:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445463168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788359514.812963:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788359514.813052:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445463168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359514.813059:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788359514.813121:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c80ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445463168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788359515.005634:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788359515.328964:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788359515.328996:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445463296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788359515.329106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359515.329173:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463296 00000100:00100000:0.0:1788359515.329181:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463296 00000100:00100000:0.0:1788359515.329233:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788359515.329242:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445463296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788359515.329276:0:17195:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788359515.329334:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445463296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359515.329341:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788359515.329385:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445463296:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1788359515.726355:0:20213:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca53131a0 20000000:00000080:1.0:1788359515.726369:0:20213:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0eafd881800 uarg=0000000000000000 20000000:01000000:1.0:1788359515.726402:0:20213:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788359515.726406:0:20213:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788359515.726409:0:20213:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788359515.727351:0:20214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788359515.727483:0:20213:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788359515.733148:0:20213:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788359515.733274:0:20213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733294:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733321:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733327:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733333:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733343:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733351:0:20213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733359:0:20213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733465:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733484:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.733808:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463424:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359515.733967:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.733976:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.734006:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463552:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359515.734041:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.734050:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.734060:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463680:0@lo:104: 00000100:00100000:0.0:1788359515.734101:0:20213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359515.734147:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.734156:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 23 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.734164:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463808:0@lo:104: 00000100:00100000:0.0:1788359515.734188:0:20213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359515.734223:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.734232:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 23 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.734240:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463936:0@lo:104: 00000100:00100000:0.0:1788359515.734261:0:20213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788359515.734277:0:20213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 23 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.734296:0:20213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 23 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.734304:0:20213:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445464064:0@lo:104: 00000100:00100000:0.0:1788359515.734349:0:20213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359515.734360:0:20213:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec2e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788359515.734450:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463680 00000100:00100000:2.0:1788359515.734459:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463680 00000100:00100000:2.0:1788359515.734534:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463808 00000100:00100000:2.0:1788359515.734538:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463808 00000100:00100000:2.0:1788359515.734550:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445463936 00000100:00100000:2.0:1788359515.734553:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445463936 00000100:00100000:2.0:1788359515.734563:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464064 00000100:00100000:2.0:1788359515.734564:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464064 00000100:00100000:2.0:1788359515.734577:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359515.734585:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+6:20213:x1875230445463680:12345-0@lo:104: 00010000:00010000:2.0:1788359515.734605:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734667:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788359515.734672:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+6:20213:x1875230445463680:12345-0@lo:104: Request processed in 88us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.734680:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359515.734698:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359515.734704:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+5:20213:x1875230445463808:12345-0@lo:104: 00010000:00010000:2.0:1788359515.734710:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734742:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788359515.734747:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+5:20213:x1875230445463808:12345-0@lo:104: Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.734753:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359515.734765:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359515.734771:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+4:20213:x1875230445463936:12345-0@lo:104: 00010000:00010000:2.0:1788359515.734778:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734810:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788359515.734815:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+4:20213:x1875230445463936:12345-0@lo:104: Request processed in 45us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.734820:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359515.734832:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359515.734837:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:20213:x1875230445464064:12345-0@lo:104: 00010000:00010000:2.0:1788359515.734850:0:17172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734881:0:17172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788359515.734886:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:caaeac2e-9afd-44da-91ff-e628fee28e20+3:20213:x1875230445464064:12345-0@lo:104: Request processed in 49us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.734893:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788359515.734922:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788359515.734928:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734936:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9800 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359515.734940:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734950:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359515.734957:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359515.734964:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359515.734990:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.734997:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359515.735015:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735022:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eac91c9800/0x49dd053b5feaf953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf95a expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735042:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788359515.735045:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735050:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eae00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359515.735052:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735060:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359515.735066:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359515.735072:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359515.735085:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735091:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359515.735097:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735103:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75eae00/0x49dd053b5feaf7f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7fc expref: -99 pid: 18691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735112:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788359515.735114:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735129:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ebc00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359515.735132:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735139:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359515.735145:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359515.735150:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359515.735162:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735168:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359515.735183:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735189:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0e9c75ebc00/0x49dd053b5feaf7b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7bd expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735199:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359515.735201:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735207:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad7c00 already unused, calling callback (ffffffffc1124c20) 10000000:00010000:2.0:1788359515.735210:0:17177:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735225:0:17177:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788359515.735232:0:17177:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359515.735238:0:17177:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788359515.735252:0:17177:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735257:0:17177:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788359515.735263:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735269:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.152@tcp lock: ffffa0eaffad7c00/0x49dd053b5feaf7a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x49dd053b5feaf7af expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735282:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359515.735283:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359515.735285:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359515.735292:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359515.735297:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359515.735301:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359515.735317:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.735349:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359515.735371:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788359515.735377:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.735395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359515.735429:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445464448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.735462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359515.735481:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788359515.735486:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445464576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.735530:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359515.735550:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464192 00000100:00100000:2.0:1788359515.735554:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464192 00010000:00010000:2.0:1788359515.735573:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 24 pid: 17184 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.735588:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464320 00000100:00100000:2.0:1788359515.735591:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464320 00010000:00010000:2.0:1788359515.735601:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 25 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.735611:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464448 00000100:00100000:2.0:1788359515.735614:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464448 00010000:00010000:2.0:1788359515.735623:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 26 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.735633:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464576 00000100:00100000:2.0:1788359515.735636:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464576 00010000:00010000:2.0:1788359515.735645:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 27 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.735657:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359515.735662:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+27:3642:x1875230445464192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.735671:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.735677:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 27 pid: 17184 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735696:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 27 pid: 17184 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735713:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.735741:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+27:3642:x1875230445464192:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.735749:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359515.735762:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359515.735768:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+26:3642:x1875230445464320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.735775:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.735779:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 26 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735786:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 26 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735794:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.735809:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+26:3642:x1875230445464320:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.735813:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788359515.735820:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359515.735824:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+25:3644:x1875230445464448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.735828:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.735831:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 25 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735835:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 25 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735846:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.735862:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+25:3644:x1875230445464448:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.735866:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788359515.735874:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359515.735878:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3644:x1875230445464576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.735883:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.735887:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 24 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735894:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 24 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.735915:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.735936:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3644:x1875230445464576:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.735942:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788359515.735980:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445464576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.735988:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:caaeac2e-9afd-44da-91ff-e628fee28e20:3644:1875230445464448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.736009:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788359515.736015:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788359515.736104:0:20213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feaf95a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf953 expref: 23 pid: 17184 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.736116:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463680:0@lo:104: 00010000:00010000:0.0:1788359515.736127:0:20213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75eb600/0x49dd053b5feaf7fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf7f5 expref: 22 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.736135:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463808:0@lo:104: 00010000:00010000:0.0:1788359515.736144:0:20213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0e9c75eb200/0x49dd053b5feaf7bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf7b6 expref: 21 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.736151:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463936:0@lo:104: 00010000:00010000:0.0:1788359515.736160:0:20213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac0030200/0x49dd053b5feaf7af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x49dd053b5feaf7a8 expref: 20 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359515.736168:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7798a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445464064:0@lo:104: 00000100:00100000:3.0:1788359515.742012:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359515.742146:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463424:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359515.742159:0:20213:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20213:1875230445463552:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359515.742201:0:20213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.742279:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230272 00000100:00100000:2.0:1788359515.742286:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230272 00010000:00010000:2.0:1788359515.742319:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.742371:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:2.0:1788359515.742381:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:2405:x1875230420230272:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.742396:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.742402:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.742413:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.742431:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaec11bc00/0x49dd053b5feafae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72e4 expref: 13 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.742445:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.742520:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:2405:x1875230420230272:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 139us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.742528:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:3.0:1788359515.743030:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359515.743133:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230400 00000100:00100000:2.0:1788359515.743138:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230400 00010000:00010000:2.0:1788359515.743156:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359515.743186:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 14 00000100:00100000:2.0:1788359515.743194:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:2404:x1875230420230400:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359515.743202:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359515.743207:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743229:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743240:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feaf9d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7274 expref: 12 pid: 17183 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743253:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743261:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743275:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743281:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743289:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743296:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743302:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359515.743306:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743314:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743347:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359515.743358:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359515.743392:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:2404:x1875230420230400:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 199us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359515.743399:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 14 00010000:00010000:0.0:1788359515.743461:0:20213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.743469:0:20213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359515.743475:0:20213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0eac91c8400/0x49dd053b5feafb1a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359516.028605:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359516.348768:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464704:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.348870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.348921:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445465216:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.348962:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.348984:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445465728:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349007:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349022:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445466240:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349042:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349065:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788359516.349071:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445464832:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349093:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349111:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445465344:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349130:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349145:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445465856:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349163:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349190:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445464960:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349226:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349244:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445465472:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349288:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c803f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445465984:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349307:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349335:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788359516.349341:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445465088:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349378:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445465600:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349412:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445466112:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359516.349453:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464704 00000100:00100000:2.0:1788359516.349459:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464704 00000100:00100000:2.0:1788359516.349524:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359516.349534:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+20:3642:x1875230445464704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349579:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+20:3642:x1875230445464704:12345-0@lo:400:kworker.0 Request processed in 46us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349585:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788359516.349614:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465216 00000100:00100000:2.0:1788359516.349618:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465216 00000100:00100000:2.0:1788359516.349638:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465728 00000100:00100000:2.0:1788359516.349641:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465728 00000100:00100000:2.0:1788359516.349651:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466240 00000100:00100000:2.0:1788359516.349653:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466240 00000100:00100000:2.0:1788359516.349673:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465856 00000100:00100000:2.0:1788359516.349676:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465856 00000100:00100000:2.0:1788359516.349697:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465984 00000100:00100000:2.0:1788359516.349700:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465984 00000100:00100000:2.0:1788359516.349710:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466112 00000100:00100000:2.0:1788359516.349712:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466112 00000100:00100000:2.0:1788359516.349722:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788359516.349727:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445465216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349756:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875230445465216:12345-0@lo:400:kworker.0 Request processed in 28us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349762:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788359516.349773:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359516.349778:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445465728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349804:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875230445465728:12345-0@lo:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349809:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788359516.349820:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359516.349825:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445466240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349852:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875230445466240:12345-0@lo:400:kworker.0 Request processed in 27us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349858:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788359516.349868:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359516.349874:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445465856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349912:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875230445465856:12345-0@lo:400:kworker.0 Request processed in 38us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349918:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788359516.349928:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359516.349934:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445465984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.349976:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875230445465984:12345-0@lo:400:kworker.0 Request processed in 42us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.349982:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788359516.350001:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359516.350007:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445466112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350038:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875230445466112:12345-0@lo:400:kworker.0 Request processed in 30us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350044:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788359516.350084:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464832 00000100:00100000:2.0:1788359516.350087:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464832 00000100:00100000:2.0:1788359516.350112:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465344 00000100:00100000:2.0:1788359516.350115:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465344 00000100:00100000:2.0:1788359516.350128:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359516.350133:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445464832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350178:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875230445464832:12345-0@lo:400:kworker.0 Request processed in 44us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350184:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788359516.350196:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788359516.350202:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445465344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350228:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875230445465344:12345-0@lo:400:kworker.0 Request processed in 27us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350233:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788359516.350257:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445464960 00000100:00100000:2.0:1788359516.350260:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445464960 00000100:00100000:2.0:1788359516.350286:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465472 00000100:00100000:2.0:1788359516.350289:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465472 00000100:00100000:2.0:1788359516.350300:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465088 00000100:00100000:2.0:1788359516.350308:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465088 00000100:00100000:2.0:1788359516.350325:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445465600 00000100:00100000:2.0:1788359516.350327:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445465600 00000100:00100000:2.0:1788359516.350339:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359516.350344:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445464960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350373:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445464960:12345-0@lo:400:kworker.0 Request processed in 29us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350378:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788359516.350389:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788359516.350394:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445465472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350416:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445465472:12345-0@lo:400:kworker.0 Request processed in 22us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350421:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788359516.350430:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359516.350436:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350464:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1875230445465088:12345-0@lo:400:kworker.0 Request processed in 28us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350469:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788359516.350480:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788359516.350487:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445465600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350536:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445465600:12345-0@lo:400:kworker.0 Request processed in 50us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359516.350542:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788359516.350569:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359516.350573:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359516.350575:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788359516.350577:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788359516.350618:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445465088:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350631:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445465600:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350641:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3644:1875230445466112:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350650:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445464960:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350658:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445465472:0@lo:400:kworker.0 00010000:00080000:2.0:1788359516.350670:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0e9c803f100 x1875230445465984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359516.350680:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3644:1875230445465984:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350721:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3642:1875230445464832:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350730:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3642:1875230445465344:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350737:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c803e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3642:1875230445465856:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350744:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:caaeac2e-9afd-44da-91ff-e628fee28e20:3642:1875230445464704:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350751:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875230445465216:0@lo:400:kworker.0 00000100:00100000:2.0:1788359516.350758:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875230445465728:0@lo:400:kworker.0 00010000:00080000:2.0:1788359516.350767:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffac6a00 x1875230445466240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788359516.350775:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3642:1875230445466240:0@lo:400:kworker.0 00000100:00100000:0.0:1788359516.353695:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445466368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788359516.353760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359516.353819:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466368 00000100:00100000:0.0:1788359516.353826:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466368 00000100:00100000:0.0:1788359516.353877:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359516.353889:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445466368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788359516.353934:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788359516.353986:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445466368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359516.353994:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788359516.354050:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445466368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788359516.354987:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788359516.355002:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445466496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788359516.355040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359516.355331:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466496 00000100:00100000:1.0:1788359516.355338:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466496 00000100:00100000:1.0:1788359516.355371:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788359516.355378:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445466496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788359516.355393:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788359516.355441:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875230445466496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359516.355448:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788359516.357953:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445466496:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788359516.863482:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of baeaa55a-ca44-4479-b153-533092acc688 00000001:00080000:1.0:1788359516.863525:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1788359517.052634:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788359517.052920:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788359517.052925:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eafd872000 from 13 10000000:01000000:0.0:1788359517.052930:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788359517.053041:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359517.053054:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359517.053078:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359517.053104:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788359517.053238:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788359517.054994:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec2e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788359517.055596:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466624 00000100:00100000:2.0:1788359517.055606:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466624 00000100:00100000:2.0:1788359517.055703:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788359517.055714:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+20:17186:x1875230445466624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.055731:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359517.055751:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11b600/0x49dd053b5feafb28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feafb21 expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.055779:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11b600/0x49dd053b5feafb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feafb21 expref: 21 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.055789:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11b600/0x49dd053b5feafb28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feafb21 expref: 21 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.055799:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11b600, rc 0) 00000100:00100000:2.0:1788359517.055860:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445466624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.055867:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788359517.057628:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c779aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.057652:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb28 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.057662:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feafb28 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359517.057745:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.057790:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.057829:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788359517.058146:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466752 00000100:00100000:3.0:1788359517.058152:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466752 00000100:00100000:3.0:1788359517.058260:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788359517.058270:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445466752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.058403:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445466752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.058416:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788359517.059903:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.059961:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.064197:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.064257:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788359517.064394:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445466880 00000100:00100000:0.0:1788359517.064403:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445466880 00000100:00100000:0.0:1788359517.064461:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788359517.064470:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445466880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788359517.064605:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445466880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359517.064614:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788359517.065097:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445466880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788359517.066211:0:20300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788359517.066385:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788359517.066406:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788359517.066416:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb28 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.066427:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eac91c8000/0x49dd053b5feafb21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb28 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788359517.066436:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788359517.066439:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eac6839000 from 13 10000000:01000000:3.0:1788359517.066441:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788359517.066472:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.066480:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.066489:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359517.066535:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.066585:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359517.066619:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6baa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359517.068234:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467008 00000100:00100000:2.0:1788359517.068247:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467008 00000100:00100000:2.0:1788359517.068306:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788359517.068316:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+21:17186:x1875230445467008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.068331:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359517.068347:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11b800/0x49dd053b5feafb36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feafb2f expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.068372:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11b800/0x49dd053b5feafb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feafb2f expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.068382:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11b800/0x49dd053b5feafb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feafb2f expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.068391:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11b800, rc 0) 00000100:00100000:2.0:1788359517.068458:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.068465:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788359517.068559:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359517.068575:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb36 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.068584:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feafb36 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359517.068656:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.068684:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359517.068722:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6baa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359517.068919:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467136 00000100:00100000:2.0:1788359517.068923:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467136 00000100:00100000:2.0:1788359517.068963:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788359517.068970:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.069087:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.069094:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788359517.069300:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.069330:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.069368:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359517.069391:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6baa3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788359517.069868:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467264 00000100:00100000:2.0:1788359517.069874:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467264 00000100:00100000:2.0:1788359517.069917:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788359517.069924:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.070020:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.070027:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788359517.070231:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0ead27bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788359517.072943:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788359517.073015:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788359517.073035:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359517.073046:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb36 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.073057:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaffad6a00/0x49dd053b5feafb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb36 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359517.073068:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359517.073071:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0eaffa8a000 from 13 10000000:01000000:2.0:1788359517.073074:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359517.073106:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.073114:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.073150:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359517.073174:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.073233:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.073283:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359517.073541:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467392 00000100:00100000:3.0:1788359517.073548:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467392 00000100:00100000:3.0:1788359517.073590:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788359517.073599:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+22:17186:x1875230445467392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359517.073613:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359517.073625:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7a00/0x49dd053b5feafb44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feafb3d expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.073647:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7a00/0x49dd053b5feafb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feafb3d expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.073657:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7a00/0x49dd053b5feafb44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feafb3d expref: 23 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.073664:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7a00, rc 0) 00000100:00100000:3.0:1788359517.073707:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.073720:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788359517.075022:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.075039:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb44 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.075048:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feafb44 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359517.075111:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.075142:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.075169:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788359517.075207:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467520 00000100:00100000:0.0:1788359517.075213:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467520 00000100:00100000:0.0:1788359517.075254:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788359517.075262:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788359517.075383:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359517.075392:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788359517.075403:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.075436:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.075478:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.075579:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359517.075651:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467648 00000100:00100000:3.0:1788359517.075655:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467648 00000100:00100000:3.0:1788359517.075681:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788359517.075690:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.075808:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.075816:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788359517.075913:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788359517.076699:0:20302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788359517.076922:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788359517.076947:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359517.076956:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb44 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.076974:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaec11b400/0x49dd053b5feafb3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb44 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788359517.076984:0:17186:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788359517.076986:0:17186:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0ead20a0000 from 13 10000000:01000000:2.0:1788359517.076989:0:17186:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788359517.077014:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.077020:0:17186:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.077026:0:17186:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359517.077039:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.077073:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.077129:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359517.077920:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467776 00000100:00100000:3.0:1788359517.077926:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467776 00000100:00100000:3.0:1788359517.078007:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788359517.078015:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+23:17186:x1875230445467776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788359517.078025:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359517.078037:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feafb52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x49dd053b5feafb4b expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.078055:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feafb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x49dd053b5feafb4b expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.078062:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaffad7c00/0x49dd053b5feafb52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x49dd053b5feafb4b expref: 24 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359517.078068:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7c00, rc 0) 00000100:00100000:3.0:1788359517.078154:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445467776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.078159:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788359517.078211:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.078227:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb52 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.078235:0:17186:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x49dd053b5feafb52 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359517.078290:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.078317:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.078336:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788359517.078346:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445467904 00000100:00100000:2.0:1788359517.078349:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445467904 00000100:00100000:2.0:1788359517.078368:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788359517.078373:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445467904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.078464:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445467904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.078471:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788359517.078525:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445467904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.078564:0:17186:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445468032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.078602:0:17186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.078624:0:17186:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c57d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788359517.078701:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445468032 00000100:00100000:3.0:1788359517.078711:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445468032 00000100:00100000:3.0:1788359517.078765:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788359517.078772:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445468032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.078839:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:caaeac2e-9afd-44da-91ff-e628fee28e20+24:17186:x1875230445468032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.078853:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788359517.080089:0:17186:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:caaeac2e-9afd-44da-91ff-e628fee28e20:17186:1875230445468032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788359517.082381:0:20304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788359517.082929:0:17186:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788359517.082952:0:17186:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788359517.082963:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb52 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.082975:0:17186:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.152@tcp lock: ffffa0eaec11ae00/0x49dd053b5feafb4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x49dd053b5feafb52 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359517.115256:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115309:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115328:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115342:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115360:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115389:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115404:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115420:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359517.115446:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359517.115543:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230656 00000100:00100000:2.0:1788359517.115553:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230656 00000100:00100000:2.0:1788359517.115609:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231168 00000100:00100000:2.0:1788359517.115612:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231168 00000100:00100000:2.0:1788359517.115629:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230784 00000100:00100000:2.0:1788359517.115631:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230784 00000100:00100000:2.0:1788359517.115648:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231296 00000100:00100000:2.0:1788359517.115657:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231296 00000100:00100000:2.0:1788359517.115680:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:2.0:1788359517.115690:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:2403:x1875230420230656:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.115763:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:2403:x1875230420230656:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 75us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.115771:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:2.0:1788359517.115790:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:2.0:1788359517.115798:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+7:2403:x1875230420231168:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.115826:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+7:2403:x1875230420231168:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.115832:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:2.0:1788359517.115844:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:2.0:1788359517.115850:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420230784:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.115929:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420230784:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 79us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.115937:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:2.0:1788359517.115953:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:2.0:1788359517.115959:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+6:2403:x1875230420231296:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.115985:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+6:2403:x1875230420231296:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.115992:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:2.0:1788359517.116010:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230912 00000100:00100000:2.0:1788359517.116015:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230912 00000100:00100000:2.0:1788359517.116175:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231424 00000100:00100000:1.0:1788359517.116182:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231040 00000100:00100000:2.0:1788359517.116185:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231424 00000100:00100000:2.0:1788359517.116210:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231552 00000100:00100000:2.0:1788359517.116212:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231552 00000100:00100000:2.0:1788359517.116231:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359517.116237:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420230912:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.116261:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420230912:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 25us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.116269:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359517.116281:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:2.0:1788359517.116286:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:baeaa55a-ca44-4479-b153-533092acc688+6:2403:x1875230420231424:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359517.116303:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231040 00000100:00100000:2.0:1788359517.116310:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:baeaa55a-ca44-4479-b153-533092acc688+6:2403:x1875230420231424:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 23us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.116317:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:2.0:1788359517.116335:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:1.0:1788359517.116349:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:2.0:1788359517.116376:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:baeaa55a-ca44-4479-b153-533092acc688+5:2403:x1875230420231552:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:1.0:1788359517.116377:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420231040:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.116403:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:baeaa55a-ca44-4479-b153-533092acc688+5:2403:x1875230420231552:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 60us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.116412:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 12 00000100:00100000:1.0:1788359517.116425:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2403:x1875230420231040:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 66us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359517.116433:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 13 00000100:00100000:2.0:1788359517.116442:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420230528 00000100:00100000:2.0:1788359517.116447:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420230528 00000100:00100000:2.0:1788359517.116479:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 153 00000100:00100000:2.0:1788359517.116487:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:2403:x1875230420230528:12345-192.168.202.52@tcp:400:kworker.0 00000100:00100000:2.0:1788359517.116555:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:2403:x1875230420230528:12345-192.168.202.52@tcp:400:kworker.0 Request processed in 68us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.116562:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 153 00000100:00080000:2.0:1788359517.116612:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788359517.116617:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788359517.116621:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788359517.116625:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359517.181907:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359517.181997:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231680 00000100:00100000:2.0:1788359517.182018:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231680 00000100:00100000:2.0:1788359517.182114:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 154 00000100:00100000:2.0:1788359517.182128:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+11:14935:x1875230420231680:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.182153:0:17183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359517.182315:0:17183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feafb59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e731c expref: -99 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.182361:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feafb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e731c expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.182373:0:17183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11aa00/0x49dd053b5feafb59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e731c expref: 12 pid: 17183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.182383:0:17183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11aa00, rc 0) 00000100:00100000:2.0:1788359517.182659:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eae54cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420231680:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 534us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.182668:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 154 00000100:00100000:2.0:1788359517.187937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359517.188041:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231808 00000100:00100000:3.0:1788359517.188055:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231808 00000100:00100000:3.0:1788359517.188131:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 155 00000100:00100000:3.0:1788359517.188141:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420231808:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788359517.188362:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420231808:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 221us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359517.188371:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 155 00000100:00100000:1.0:1788359517.195635:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359517.195707:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420231936 00000100:00100000:2.0:1788359517.195725:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420231936 00000100:00100000:2.0:1788359517.195816:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 156 00000100:00100000:2.0:1788359517.195829:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420231936:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.196335:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420231936:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 508us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.196352:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 156 00000100:00100000:1.0:1788359517.200667:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359517.200725:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232064 00000100:00100000:2.0:1788359517.200740:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232064 00000100:00100000:2.0:1788359517.200815:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:2.0:1788359517.200828:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+12:14935:x1875230420232064:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788359517.200849:0:17184:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359517.200870:0:17184:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feafb60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7323 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.200919:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feafb60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7323 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.200932:0:17184:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0eaec11a200/0x49dd053b5feafb60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7323 expref: 13 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359517.200944:0:17184:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec11a200, rc 0) 00000100:00100000:2.0:1788359517.201032:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:14935:x1875230420232064:12345-192.168.202.52@tcp:101:ll_cfg_requeue.0 Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.201039:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 157 00000100:00100000:2.0:1788359517.207586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359517.207729:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232192 00000100:00100000:1.0:1788359517.207741:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232192 00000100:00100000:1.0:1788359517.207845:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:1.0:1788359517.207857:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:14935:x1875230420232192:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788359517.208075:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:14935:x1875230420232192:12345-192.168.202.52@tcp:501:ll_cfg_requeue.0 Request processed in 219us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359517.208085:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 158 00000100:00100000:1.0:1788359517.216023:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359517.216955:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232320 00000100:00100000:2.0:1788359517.216973:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232320 00000100:00100000:2.0:1788359517.217067:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:2.0:1788359517.217080:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:14935:x1875230420232320:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788359517.217300:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8e20f3f2-a4c2-4c6c-95b2-c4846e9720de+13:14935:x1875230420232320:12345-192.168.202.52@tcp:503:ll_cfg_requeue.0 Request processed in 222us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.217322:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 159 00000100:00100000:1.0:1788359517.885670:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788359517.885934:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445468160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788359517.886013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359517.886148:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445468160 00000100:00100000:2.0:1788359517.886157:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445468160 00000100:00100000:2.0:1788359517.886249:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788359517.886259:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445468160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788359517.886412:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788359517.886477:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c80ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875230445468160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359517.886485:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788359517.886596:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3644:1875230445468160:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1788359517.889157:0:17921:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of baeaa55a-ca44-4479-b153-533092acc688 00000001:00100000:2.0:1788359517.889579:0:17169:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of baeaa55a-ca44-4479-b153-533092acc688 00000001:00100000:3.0:1788359517.890062:0:18692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of baeaa55a-ca44-4479-b153-533092acc688 00010000:00010000:2.0:1788359518.076698:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788359518.102049:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.102981:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232448 00000100:00100000:2.0:1788359518.102997:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232448 00000100:00100000:2.0:1788359518.103086:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:2.0:1788359518.103098:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+6:15602:x1875230420232448:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359518.103127:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.103160:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11be00/0x49dd053b5feafb67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e732a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103252:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103270:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103284:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103344:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103360:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103367:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103479:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8e00/0x49dd053b5feafb7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103488:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8e00/0x49dd053b5feafb7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103535:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8e00/0x49dd053b5feafb7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359518.103573:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788359518.103578:0:17190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359518.103623:0:17190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8e00/0x49dd053b5feafb7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103637:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103644:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103652:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103669:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec11bc00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.103674:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103682:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103697:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:2.0:1788359518.103701:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.103707:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103713:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11bc00/0x49dd053b5feafb6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103729:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103735:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103741:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103745:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.103748:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103754:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103773:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0eb020dd500) 00010000:00010000:2.0:1788359518.103776:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.103779:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103785:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103825:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec11be00/0x49dd053b5feafb67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e732a expref: 8 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103842:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8e00/0x49dd053b5feafb7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e732a expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.103849:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eb020ddc00) 00010000:00010000:2.0:1788359518.103851:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359518.103853:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c8e00, rc 0) 00000100:00100000:2.0:1788359518.103960:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+7:15602:x1875230420232448:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 864us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.103968:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 23 00000100:00100000:3.0:1788359518.106201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.106323:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232576 00000100:00100000:0.0:1788359518.106339:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232576 00000100:00100000:0.0:1788359518.106418:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:0.0:1788359518.106429:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74da3620-4733-4f31-913b-e0b808f61386+7:15602:x1875230420232576:12345-192.168.202.52@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788359518.106554:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74da3620-4733-4f31-913b-e0b808f61386+7:15602:x1875230420232576:12345-192.168.202.52@tcp:900:lhsmtool_posix.0 Request processed in 127us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.106563:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:1.0:1788359518.111435:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.111778:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232832 00000100:00100000:2.0:1788359518.111795:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232832 00000100:00100000:2.0:1788359518.111888:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:2.0:1788359518.111903:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+7:15602:x1875230420232832:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359518.111932:0:18578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.111960:0:18578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7331 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.112092:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.112111:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.112126:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114334:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114360:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114373:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114795:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9000/0x49dd053b5feafb98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114805:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9000/0x49dd053b5feafb98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.114812:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9000/0x49dd053b5feafb98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359518.114824:0:18578:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788359518.115027:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115048:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115055:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115071:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.115076:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115084:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115097:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0eb020ddc00) 00010000:00010000:2.0:1788359518.115100:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.115106:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115111:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafb8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115124:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115130:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115136:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115140:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.115150:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115156:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115163:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0eb020dd500) 00010000:00010000:2.0:1788359518.115166:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.115169:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.115175:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafb91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.116620:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafb83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7331 expref: 10 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.116647:0:18578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9000/0x49dd053b5feafb98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7331 expref: 9 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.116657:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eb020dd000) 00010000:00010000:2.0:1788359518.116659:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.116662:0:18578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c9000, rc 0) 00000100:00100000:2.0:1788359518.116734:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+9:15602:x1875230420232832:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 4835us (5314us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788359518.116743:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:1.0:1788359518.120637:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.120750:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420232960 00000100:00100000:0.0:1788359518.120763:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420232960 00000100:00100000:0.0:1788359518.120899:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:0.0:1788359518.120914:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+9:15602:x1875230420232960:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788359518.121079:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+9:15602:x1875230420232960:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 169us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.121088:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:3.0:1788359518.128093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.128690:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233088 00000100:00100000:0.0:1788359518.128704:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233088 00000100:00100000:2.0:1788359518.129802:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 26 00000100:00100000:2.0:1788359518.129823:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+5:15602:x1875230420233088:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788359518.145842:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.145955:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233216 00000100:00100000:0.0:1788359518.145969:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233216 00000004:00080000:2.0:1788359518.145985:0:18578:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 16095us 00000100:00100000:0.0:1788359518.146062:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:2.0:1788359518.146072:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788359518.146076:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+9:15608:x1875230420233216:12345-192.168.202.52@tcp:101:lfs.0 00000100:00100000:2.0:1788359518.146085:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00010000:0.0:1788359518.146118:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.146149:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafba6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7338 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146241:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146260:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146277:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146297:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146305:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146314:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146372:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146386:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146394:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146401:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359518.146413:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146422:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146437:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:0.0:1788359518.146441:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.146446:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146453:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146469:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146477:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146520:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146528:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359518.146531:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146538:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146549:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:0.0:1788359518.146552:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.146562:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146569:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146615:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafba6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7338 expref: 10 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146628:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:0.0:1788359518.146631:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.146636:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafba6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7338 expref: 10 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.146649:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8400, rc 0) 00000100:00100000:0.0:1788359518.146728:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+9:15608:x1875230420233216:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 655us (900us total) trans 0 rc 301/301 00000100:00100000:0.0:1788359518.146738:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:3.0:1788359518.151431:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.154029:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233344 00000100:00100000:0.0:1788359518.154063:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233344 00000100:00100000:0.0:1788359518.154139:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:0.0:1788359518.154153:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74da3620-4733-4f31-913b-e0b808f61386+9:15608:x1875230420233344:12345-192.168.202.52@tcp:700:lfs.0 00000100:00100000:0.0:1788359518.154275:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74da3620-4733-4f31-913b-e0b808f61386+9:15608:x1875230420233344:12345-192.168.202.52@tcp:700:lfs.0 Request processed in 126us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.154284:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:0.0:1788359518.159581:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.159754:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233600 00000100:00100000:2.0:1788359518.159768:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233600 00000100:00100000:2.0:1788359518.159841:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:2.0:1788359518.159853:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+9:15608:x1875230420233600:12345-192.168.202.52@tcp:36:lfs.0 00010000:00010000:2.0:1788359518.159942:0:17189:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359518.159978:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafa02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e72a5 expref: 9 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.160001:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:2.0:1788359518.160008:0:17189:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359518.160087:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.160103:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 5 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.160112:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.160153:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 5 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.160170:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 5 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.160188:0:17189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468288:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359518.160359:0:17189:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788359518.161658:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+5:15602:x1875230420233088:12345-192.168.202.52@tcp:59:lhsmtool_posix.0 Request processed in 31837us (33575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.161681:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 26 00000100:00100000:0.0:1788359518.168432:0:17189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468288:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359518.168471:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359518.168889:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.168997:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233728 00000100:00100000:3.0:1788359518.169005:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233728 00010000:00010000:3.0:1788359518.169049:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 6 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359518.169116:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 15 00000100:00100000:3.0:1788359518.169126:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:baeaa55a-ca44-4479-b153-533092acc688+6:2404:x1875230420233728:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359518.169163:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359518.169171:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 6 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169185:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 6 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169213:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea800/0x49dd053b5feafb13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7315 expref: 6 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169232:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:3.0:1788359518.169238:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169249:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169257:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.169285:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359518.169340:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:baeaa55a-ca44-4479-b153-533092acc688+5:2404:x1875230420233728:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 215us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.169347:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 15 00010000:00010000:0.0:1788359518.169397:0:17189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.169405:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.169434:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.169444:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.169452:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.170927:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.170944:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.170953:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359518.170975:0:17189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000768ace55 reply state 000000002bab550b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.170993:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171001:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:0.0:1788359518.171004:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359518.171008:0:17189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788359518.171014:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788359518.171021:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171026:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171032:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171038:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359518.171042:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171049:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171059:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead27a0800) 00010000:00010000:0.0:1788359518.171061:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.171064:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171070:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafbbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359518.171100:0:17189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000768ace55 reply state 000000002bab550b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171109:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.171114:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:0.0:1788359518.171116:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788359518.171119:0:17189:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788359518.171225:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+10:15608:x1875230420233600:12345-192.168.202.52@tcp:36:lfs.0 Request processed in 11370us (11653us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788359518.171235:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:0.0:1788359518.236858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.237654:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233856 00000100:00100000:3.0:1788359518.237667:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233856 00000100:00100000:3.0:1788359518.237793:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:3.0:1788359518.237807:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+10:15616:x1875230420233856:12345-192.168.202.52@tcp:101:lctl.0 00010000:00010000:3.0:1788359518.237848:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359518.237872:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feafbd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e733f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.237982:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feafbd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.237996:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feafbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.238007:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feafbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359518.238055:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359518.238060:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359518.238095:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feafbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.238120:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feafbd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e733f expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.238140:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad7400/0x49dd053b5feafbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e733f expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.238149:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:3.0:1788359518.238152:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788359518.238156:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaffad7400, rc 0) 00000100:00100000:3.0:1788359518.238217:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+11:15616:x1875230420233856:12345-192.168.202.52@tcp:101:lctl.0 Request processed in 414us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.238225:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:2.0:1788359518.261572:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.261697:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420233984 00000100:00100000:0.0:1788359518.261708:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420233984 00000100:00100000:0.0:1788359518.261813:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:0.0:1788359518.261823:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+5:15617:x1875230420233984:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359518.261844:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.261864:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7346 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.261941:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feafbe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.261956:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feafbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.261968:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feafbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359518.262026:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788359518.262031:0:17190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359518.262052:0:17190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feafbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.262079:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7346 expref: 7 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.262099:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9200/0x49dd053b5feafbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7346 expref: 6 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.262108:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:0.0:1788359518.262111:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359518.262114:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9200, rc 0) 00000100:00100000:0.0:1788359518.262302:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+6:15617:x1875230420233984:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 479us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.262310:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 30 00000100:00100000:1.0:1788359518.265010:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.265642:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420234112 00000100:00100000:0.0:1788359518.265652:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420234112 00000100:00100000:0.0:1788359518.265747:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:0.0:1788359518.265757:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+6:15617:x1875230420234112:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359518.265776:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.265796:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafbec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e734d expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265868:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265908:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265920:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265932:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265939:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.265946:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266025:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266032:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266039:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359518.266071:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788359518.266075:0:17189:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359518.266092:0:17189:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266104:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266119:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266126:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266131:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9c00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359518.266135:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266142:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266153:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:0.0:1788359518.266156:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.266160:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266166:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafbf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266180:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266185:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266204:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266210:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359518.266218:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266225:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266233:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:0.0:1788359518.266235:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359518.266238:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266244:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafbfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266268:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafbec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e734d expref: 8 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266281:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e734d expref: 7 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.266288:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:0.0:1788359518.266290:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788359518.266292:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8e00, rc 0) 00000100:00100000:0.0:1788359518.266350:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead28de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+7:15617:x1875230420234112:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 594us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.266356:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 31 00000100:00100000:1.0:1788359518.270060:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.270144:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420234240 00000100:00100000:3.0:1788359518.270153:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420234240 00000100:00100000:3.0:1788359518.270324:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:3.0:1788359518.270334:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baeaa55a-ca44-4479-b153-533092acc688+5:15617:x1875230420234240:12345-192.168.202.52@tcp:900:lfs.0 00000100:00100000:3.0:1788359518.270420:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:baeaa55a-ca44-4479-b153-533092acc688+5:15617:x1875230420234240:12345-192.168.202.52@tcp:900:lfs.0 Request processed in 87us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.270427:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359518.276331:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.279072:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420234496 00000100:00100000:0.0:1788359518.279093:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420234496 00000100:00100000:0.0:1788359518.279199:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:0.0:1788359518.279211:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:baeaa55a-ca44-4479-b153-533092acc688+7:15617:x1875230420234496:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359518.279258:0:20328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.279287:0:20328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafc08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7354 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359518.279601:0:20328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788359518.279761:0:20328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafc08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7354 expref: 9 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.279780:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:0.0:1788359518.279784:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359518.279790:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafc08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7354 expref: 9 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.279812:0:20328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9a00, rc 0) 00000100:00100000:0.0:1788359518.280122:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:baeaa55a-ca44-4479-b153-533092acc688+8:15617:x1875230420234496:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 911us (3804us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788359518.280131:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 32 00000100:00100000:1.0:1788359518.287711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.287810:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420234752 00000100:00100000:0.0:1788359518.287823:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420234752 00000100:00100000:0.0:1788359518.287905:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:0.0:1788359518.287927:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+8:15617:x1875230420234752:12345-192.168.202.52@tcp:36:lfs.0 00010000:00010000:0.0:1788359518.288002:0:17190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359518.288038:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafc01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e734d expref: 8 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.288064:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:0.0:1788359518.288070:0:17190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359518.288116:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.288133:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.288145:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788359518.288425:0:17190:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfbe4d5e reply state 00000000345396bc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.288440:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.288447:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:0.0:1788359518.288449:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788359518.288452:0:17190:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788359518.288461:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788359518.288594:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:baeaa55a-ca44-4479-b153-533092acc688+9:15617:x1875230420234752:12345-192.168.202.52@tcp:36:lfs.0 Request processed in 678us (898us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788359518.288602:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 33 00000100:00100000:1.0:1788359518.294028:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.294207:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235008 00000100:00100000:2.0:1788359518.294221:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235008 00000100:00100000:2.0:1788359518.294296:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:2.0:1788359518.294310:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+9:15617:x1875230420235008:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359518.294664:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+10:15617:x1875230420235008:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 355us (650us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788359518.294672:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:2.0:1788359518.298016:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.301311:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235264 00000100:00100000:0.0:1788359518.301336:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235264 00000100:00100000:1.0:1788359518.306675:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:1.0:1788359518.306698:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+10:15617:x1875230420235264:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:1.0:1788359518.307133:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359518.307166:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feafc1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e735b expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307286:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307304:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307318:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307330:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307337:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307343:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359518.307532:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788359518.307637:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307645:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307653:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307673:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359518.307678:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307687:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307702:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:1.0:1788359518.307706:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359518.307712:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307720:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb200/0x49dd053b5feafc24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307753:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307761:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307767:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307773:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75eb600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359518.307776:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307782:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307801:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:1.0:1788359518.307804:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359518.307807:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307813:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb600/0x49dd053b5feafc2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307856:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feafc1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e735b expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307868:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:1.0:1788359518.307870:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788359518.307886:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb000/0x49dd053b5feafc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e735b expref: 12 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.307897:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb000, rc 0) 00000100:00100000:1.0:1788359518.308109:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:baeaa55a-ca44-4479-b153-533092acc688+11:15617:x1875230420235264:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 1417us (10106us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788359518.308118:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 34 00000100:00100000:1.0:1788359518.312433:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.312659:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235392 00000100:00100000:2.0:1788359518.312678:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235392 00000100:00100000:2.0:1788359518.312762:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:2.0:1788359518.312776:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baeaa55a-ca44-4479-b153-533092acc688+11:15617:x1875230420235392:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:2.0:1788359518.312816:0:18578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.312849:0:18578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7362 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313008:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313029:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313045:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359518.313099:0:18578:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788359518.313103:0:18578:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359518.313127:0:18578:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313161:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 13 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313181:0:18578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 12 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.313191:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:2.0:1788359518.313194:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788359518.313199:0:18578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c8200, rc 0) 00000100:00100000:2.0:1788359518.313280:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:baeaa55a-ca44-4479-b153-533092acc688+12:15617:x1875230420235392:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 507us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.313288:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 35 00000100:00100000:0.0:1788359518.321963:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.322137:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235520 00000100:00100000:2.0:1788359518.322155:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235520 00000100:00100000:2.0:1788359518.322246:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:2.0:1788359518.322260:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+12:15617:x1875230420235520:12345-192.168.202.52@tcp:37:lfs.0 00000100:00100000:2.0:1788359518.329033:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:baeaa55a-ca44-4479-b153-533092acc688+12:15617:x1875230420235520:12345-192.168.202.52@tcp:37:lfs.0 Request processed in 6120us (6432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.329054:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 3 00000100:00100000:1.0:1788359518.331825:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.331954:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235776 00000100:00100000:0.0:1788359518.331969:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235776 00000100:00100000:0.0:1788359518.332044:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:0.0:1788359518.332056:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eafeffe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baeaa55a-ca44-4479-b153-533092acc688+12:15617:x1875230420235776:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:0.0:1788359518.332355:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eafeffe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:baeaa55a-ca44-4479-b153-533092acc688+13:15617:x1875230420235776:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 300us (544us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788359518.332386:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 4 00000100:00100000:0.0:1788359518.375309:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.380760:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420235904 00000100:00100000:3.0:1788359518.380784:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420235904 00000100:00100000:3.0:1788359518.380894:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:3.0:1788359518.380905:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+11:15623:x1875230420235904:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:3.0:1788359518.381081:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359518.381111:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feafc47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7369 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381259:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381278:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381295:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381309:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381317:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381344:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381546:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181800/0x49dd053b5feafc5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381557:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181800/0x49dd053b5feafc5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381565:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181800/0x49dd053b5feafc5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359518.381611:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788359518.381615:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788359518.381654:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181800/0x49dd053b5feafc5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381666:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381671:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381676:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381680:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaffad6000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359518.381683:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381688:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381704:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:3.0:1788359518.381706:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359518.381711:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381715:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6000/0x49dd053b5feafc4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381725:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381728:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381731:0:17191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381735:0:17191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359518.381737:0:17191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381740:0:17191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381744:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:3.0:1788359518.381745:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788359518.381746:0:17191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381749:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381779:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaffad6200/0x49dd053b5feafc47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7369 expref: 13 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381789:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181800/0x49dd053b5feafc5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7369 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.381795:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:3.0:1788359518.381796:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788359518.381798:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac7181800, rc 0) 00000100:00100000:3.0:1788359518.381886:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+12:15623:x1875230420235904:12345-192.168.202.52@tcp:101:bash.0 Request processed in 982us (6591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.381894:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 36 00000100:00100000:3.0:1788359518.387107:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.387243:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420236032 00000100:00100000:0.0:1788359518.387256:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420236032 00000100:00100000:0.0:1788359518.387355:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:0.0:1788359518.387368:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74da3620-4733-4f31-913b-e0b808f61386+5:15623:x1875230420236032:12345-192.168.202.52@tcp:900:bash.0 00000100:00100000:0.0:1788359518.387537:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74da3620-4733-4f31-913b-e0b808f61386+5:15623:x1875230420236032:12345-192.168.202.52@tcp:900:bash.0 Request processed in 171us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.387545:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359518.393224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.393319:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420236288 00000100:00100000:2.0:1788359518.393332:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420236288 00000100:00100000:2.0:1788359518.393427:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:2.0:1788359518.393438:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+12:15623:x1875230420236288:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359518.393465:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.393534:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc63 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7370 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.393668:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.393687:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 12 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.393697:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.393738:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 12 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.393756:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 12 pid: 18578 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.393771:0:17189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468416:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359518.393883:0:17189:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82f180 going to sleep for 11 seconds 00000040:00080000:1.0:1788359518.397619:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788359518.398317:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788359518.398344:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445468544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359518.398435:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788359518.398555:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788359518.398803:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445468544 00000100:00100000:3.0:1788359518.398812:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445468544 00000100:00100000:3.0:1788359518.398869:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359518.398967:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445468544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788359518.399013:0:17929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788359518.399125:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445468544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 237us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.399132:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788359518.399490:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445468544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788359518.400532:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.400609:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420236416 00000100:00100000:2.0:1788359518.400618:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420236416 00010000:00010000:2.0:1788359518.400661:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 13 pid: 18578 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.400735:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 16 00000100:00100000:2.0:1788359518.400746:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baeaa55a-ca44-4479-b153-533092acc688+13:2404:x1875230420236416:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359518.400763:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359518.400771:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 13 pid: 18578 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.400785:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 13 pid: 18578 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.400815:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:2.0:1788359518.400821:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.400835:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.400844:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.400866:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359518.400946:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:baeaa55a-ca44-4479-b153-533092acc688+13:2404:x1875230420236416:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 201us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.400954:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 16 00010000:00010000:3.0:1788359518.402238:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafc40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7362 expref: 12 pid: 18578 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359518.402269:0:17189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468416:192.168.202.52@tcp:104: 00010000:00010000:3.0:1788359518.402297:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.402681:0:17189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.402689:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.402726:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.402741:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.402752:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407073:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407103:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407117:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359518.407134:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788359518.407175:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407183:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407191:0:17189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407198:0:17189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.407202:0:17189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407222:0:17189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407238:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:2.0:1788359518.407241:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359518.407248:0:17189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407254:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359518.407272:0:17189:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d08fb6 reply state 00000000481a23f7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407284:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407290:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0eb020dd500) 00010000:00010000:2.0:1788359518.407293:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359518.407297:0:17189:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788359518.407346:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc63 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 15 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407364:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 14 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.407373:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.407386:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788359518.407389:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c9c00, rc 0) 00000100:00100000:2.0:1788359518.407772:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+15:15623:x1875230420236288:12345-192.168.202.52@tcp:101:bash.0 Request processed in 14334us (14560us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788359518.407783:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 37 00000100:00100000:0.0:1788359518.423732:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.423854:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420236544 00000100:00100000:2.0:1788359518.423868:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420236544 00000100:00100000:2.0:1788359518.424010:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:2.0:1788359518.424022:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+15:15623:x1875230420236544:12345-192.168.202.52@tcp:101:bash.0 00010000:00010000:2.0:1788359518.424057:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.424086:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7377 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424178:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424196:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424210:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359518.424733:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788359518.424739:0:17190:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359518.424769:0:17190:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424782:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424817:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafc86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 17 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424862:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 16 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.424883:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.424887:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788359518.424891:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c8400, rc 0) 00000100:00100000:2.0:1788359518.425084:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+16:15623:x1875230420236544:12345-192.168.202.52@tcp:101:bash.0 Request processed in 1063us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.425093:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 38 00000100:00100000:0.0:1788359518.428213:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359518.428745:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420236800 00000100:00100000:1.0:1788359518.428760:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420236800 00000100:00100000:1.0:1788359518.428859:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:1.0:1788359518.428871:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+16:15623:x1875230420236800:12345-192.168.202.52@tcp:35:bash.0 00000100:00100000:1.0:1788359518.429283:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+17:15623:x1875230420236800:12345-192.168.202.52@tcp:35:bash.0 Request processed in 412us (1082us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788359518.429292:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 5 00000100:00100000:1.0:1788359518.510710:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.510894:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420237056 00000100:00100000:3.0:1788359518.510908:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420237056 00000100:00100000:3.0:1788359518.510992:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:3.0:1788359518.511004:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+17:15633:x1875230420237056:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:3.0:1788359518.511040:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359518.511068:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e737e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788359518.511221:0:17191:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788359518.511366:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e737e expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.511573:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0ead279ef00) 00010000:00010000:3.0:1788359518.511577:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788359518.511584:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafc94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e737e expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.511605:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac7180e00, rc 0) 00000100:00100000:3.0:1788359518.511694:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+18:15633:x1875230420237056:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 692us (1000us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788359518.511702:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 39 00000100:00100000:0.0:1788359518.515929:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.516017:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420237312 00000100:00100000:2.0:1788359518.516037:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420237312 00000100:00100000:2.0:1788359518.516121:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359518.516135:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+18:15633:x1875230420237312:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:2.0:1788359518.517341:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+19:15633:x1875230420237312:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 1201us (1415us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788359518.517353:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 6 00000100:00100000:2.0:1788359518.544609:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.544761:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420237568 00000100:00100000:0.0:1788359518.544776:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420237568 00000100:00100000:0.0:1788359518.544942:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:0.0:1788359518.544954:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+19:15636:x1875230420237568:12345-192.168.202.52@tcp:101:lfs.0 00010000:00010000:0.0:1788359518.544991:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.545012:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafca2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7385 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.545162:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafca9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.545176:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.545187:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafca9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359518.545198:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788359518.545306:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafca2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7385 expref: 22 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.545328:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafca9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7385 expref: 21 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.545337:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:0.0:1788359518.545340:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359518.545355:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8800, rc 0) 00000100:00100000:0.0:1788359518.545419:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+21:15636:x1875230420237568:12345-192.168.202.52@tcp:101:lfs.0 Request processed in 469us (825us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788359518.545424:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 40 00000100:00100000:1.0:1788359518.547756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.549105:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420237696 00000100:00100000:2.0:1788359518.549124:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420237696 00000100:00100000:2.0:1788359518.549216:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:2.0:1788359518.549230:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+21:15636:x1875230420237696:12345-192.168.202.52@tcp:54:lfs.0 00010000:00010000:2.0:1788359518.549342:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549362:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549395:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549445:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549454:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549463:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549470:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359518.549476:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549485:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549522:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.549527:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788359518.549534:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.549540:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafcb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.549656:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+21:15636:x1875230420237696:12345-192.168.202.52@tcp:54:lfs.0 Request processed in 428us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.549666:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 41 00000100:00100000:0.0:1788359518.549687:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.550092:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420237824 00000100:00100000:3.0:1788359518.550100:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420237824 00000100:00100000:3.0:1788359518.550156:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:3.0:1788359518.550165:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74da3620-4733-4f31-913b-e0b808f61386+21:2404:x1875230420237824:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359518.550190:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359518.550218:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafca9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7385 expref: 21 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.550233:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:3.0:1788359518.550237:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359518.550278:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74da3620-4733-4f31-913b-e0b808f61386+20:2404:x1875230420237824:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 114us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.550286:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:0.0:1788359518.553491:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359518.553599:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420238080 00000100:00100000:1.0:1788359518.553617:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420238080 00000100:00100000:1.0:1788359518.553691:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359518.553703:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+20:15636:x1875230420238080:12345-192.168.202.52@tcp:35:lfs.0 00000100:00100000:1.0:1788359518.554060:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74da3620-4733-4f31-913b-e0b808f61386+21:15636:x1875230420238080:12345-192.168.202.52@tcp:35:lfs.0 Request processed in 359us (576us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788359518.554070:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 7 00000100:00100000:1.0:1788359518.725394:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.725579:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420238336 00000100:00100000:0.0:1788359518.725594:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420238336 00000100:00100000:0.0:1788359518.725678:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:0.0:1788359518.725690:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+21:15667:x1875230420238336:12345-192.168.202.52@tcp:101:cat.0 00010000:00010000:0.0:1788359518.725746:0:18578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359518.725776:0:18578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafcbe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e738c expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.725957:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafcc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.725975:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.725991:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafcc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359518.726006:0:18578:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788359518.726166:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafcbe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e738c expref: 24 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.726191:0:18578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafcc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e738c expref: 23 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.726202:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:0.0:1788359518.726205:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359518.726210:0:18578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c8e00, rc 0) 00000100:00100000:0.0:1788359518.726301:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+23:15667:x1875230420238336:12345-192.168.202.52@tcp:101:cat.0 Request processed in 614us (930us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788359518.726310:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 42 00000100:00100000:0.0:1788359518.729808:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.729880:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.729923:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420238464 00000100:00100000:2.0:1788359518.729935:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420238464 00000100:00100000:1.0:1788359518.729957:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420238720 00000100:00100000:1.0:1788359518.729965:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420238720 00000100:00100000:1.0:1788359518.730023:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:2.0:1788359518.730024:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:1.0:1788359518.730037:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+24:15667:x1875230420238720:12345-192.168.202.52@tcp:35:cat.0 00000100:00100000:2.0:1788359518.730039:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+24:2405:x1875230420238464:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359518.730062:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359518.730093:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafcc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e738c expref: 24 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.730116:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.730122:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359518.730189:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+23:2405:x1875230420238464:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.730196:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:1.0:1788359518.730382:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+23:15667:x1875230420238720:12345-192.168.202.52@tcp:35:cat.0 Request processed in 347us (510us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788359518.730388:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 8 00000100:00100000:0.0:1788359518.771174:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.771286:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420238976 00000100:00100000:2.0:1788359518.771300:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420238976 00000100:00100000:2.0:1788359518.771434:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:2.0:1788359518.771446:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+23:15673:x1875230420238976:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:2.0:1788359518.771480:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.771553:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9800/0x49dd053b5feafcd3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e7393 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771704:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771721:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771730:0:17189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 24 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771746:0:17189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771788:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 24 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771803:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 24 pid: 17190 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.771820:0:17189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468672:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359518.771949:0:17189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.771958:0:17189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.771968:0:17189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468800:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359518.771992:0:17189:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788359518.776762:0:17189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468672:192.168.202.52@tcp:104: 00000100:00100000:3.0:1788359518.776933:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.777230:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420239104 00000100:00100000:2.0:1788359518.777240:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420239104 00010000:00010000:2.0:1788359518.777289:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 25 pid: 17190 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359518.777336:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:2.0:1788359518.777346:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+25:2404:x1875230420239104:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788359518.777385:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359518.777393:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 25 pid: 17190 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.777406:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 25 pid: 17190 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.777431:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafc8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7377 expref: 25 pid: 17190 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.777449:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.777454:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.777462:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.777468:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788359518.777589:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+24:2404:x1875230420239104:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 243us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.777596:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 17 00000100:00100000:0.0:1788359518.777674:0:17189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c693ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17189:1875230445468800:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359518.777700:0:17189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359518.777971:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.778238:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420239232 00000100:00100000:3.0:1788359518.778244:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420239232 00010000:00010000:3.0:1788359518.778267:0:17175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359518.778294:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 18 00000100:00100000:3.0:1788359518.778301:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaff039850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74da3620-4733-4f31-913b-e0b808f61386+24:2405:x1875230420239232:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359518.778307:0:17175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359518.778311:0:17175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778319:0:17175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778332:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9c00/0x49dd053b5feafc78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7370 expref: 24 pid: 17189 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778341:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:3.0:1788359518.778353:0:17175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778360:0:17175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778366:0:17175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.778397:0:17175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359518.778434:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaff039850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74da3620-4733-4f31-913b-e0b808f61386+23:2405:x1875230420239232:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 133us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.778444:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 18 00010000:00010000:1.0:1788359518.778975:0:17189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.778986:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788359518.779024:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788359518.779255:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9800/0x49dd053b5feafcd3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7393 expref: 24 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.779277:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9600/0x49dd053b5feafcda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e7393 expref: 23 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.779287:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:1.0:1788359518.779290:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788359518.779294:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c9600, rc 0) 00000100:00100000:1.0:1788359518.779357:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+23:15673:x1875230420238976:12345-192.168.202.52@tcp:101:dd.0 Request processed in 7913us (8199us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788359518.779365:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 43 00000100:00100000:3.0:1788359518.781735:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359518.781801:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420239360 00000100:00100000:2.0:1788359518.781813:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420239360 00000100:00100000:2.0:1788359518.781886:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:2.0:1788359518.781896:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+23:15673:x1875230420239360:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:2.0:1788359518.781926:0:17190:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359518.781950:0:17190:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafce8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e739a expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782019:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782036:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782049:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782188:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafce8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 25 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782205:0:17190:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 24 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359518.782215:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359518.782219:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359518.782223:0:17190:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c8800, rc 0) 00000100:00100000:2.0:1788359518.782295:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+24:15673:x1875230420239360:12345-192.168.202.52@tcp:101:dd.0 Request processed in 400us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359518.782302:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 44 00000100:00100000:2.0:1788359518.784652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.784952:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420239616 00000100:00100000:3.0:1788359518.784965:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420239616 00000100:00100000:3.0:1788359518.785053:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 45 00000100:00100000:3.0:1788359518.785066:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+24:15673:x1875230420239616:12345-192.168.202.52@tcp:36:dd.0 00010000:00010000:3.0:1788359518.785479:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.785529:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.785674:0:20328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359518.785741:0:20328:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788359518.785769:0:20328:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000041bd8b0 reply state 000000001af0029f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.785809:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.785817:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:3.0:1788359518.785820:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788359518.785826:0:20328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788359518.786028:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420239616:12345-192.168.202.52@tcp:36:dd.0 Request processed in 963us (1388us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788359518.786037:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 45 00000020:00080000:3.0:1788359518.786044:0:20328:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788359518.791205:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359518.791298:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420239744 00000100:00100000:1.0:1788359518.791312:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420239744 00000100:00100000:1.0:1788359518.791396:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:1.0:1788359518.791412:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420239744:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:1.0:1788359518.791464:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359518.791536:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feafcfd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73a1 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.791619:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feafcfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a1 expref: 28 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.791636:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feafcfd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a1 expref: 28 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359518.791683:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:1.0:1788359518.791686:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788359518.791692:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eb400, rc 0) 00000100:00100000:1.0:1788359518.791771:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+28:15673:x1875230420239744:12345-192.168.202.52@tcp:101:dd.0 Request processed in 365us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359518.791780:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 46 00000100:00100000:0.0:1788359518.804258:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.804369:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240000 00000100:00100000:3.0:1788359518.804382:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240000 00000100:00100000:3.0:1788359518.804471:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:3.0:1788359518.804483:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+28:15673:x1875230420240000:12345-192.168.202.52@tcp:103:dd.0 00010000:00010000:3.0:1788359518.804644:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359518.804681:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75eb400/0x49dd053b5feafcfd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a1 expref: 28 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.804705:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:3.0:1788359518.804712:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788359518.804783:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420240000:12345-192.168.202.52@tcp:103:dd.0 Request processed in 302us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.804791:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 2 00000100:00100000:3.0:1788359518.807758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359518.807955:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240128 00000100:00100000:0.0:1788359518.807970:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240128 00000100:00100000:0.0:1788359518.808048:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:0.0:1788359518.808061:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420240128:12345-192.168.202.52@tcp:58:dd.0 00010000:00010000:0.0:1788359518.808213:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.808234:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359518.808247:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788359518.810838:0:18578:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788359518.810894:0:18578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788359518.811056:0:18578:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788359518.811186:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420240128:12345-192.168.202.52@tcp:58:dd.0 Request processed in 3122us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359518.811199:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 47 00000100:00100000:2.0:1788359518.816550:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359518.816730:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240256 00000100:00100000:3.0:1788359518.816744:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240256 00000100:00100000:3.0:1788359518.816897:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 48 00000100:00100000:3.0:1788359518.816910:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+27:15673:x1875230420240256:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:3.0:1788359518.816937:0:20328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788359518.816965:0:20328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73a8 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817036:0:20328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817047:0:20328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 28 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817072:0:20328:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817088:0:20328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 28 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817104:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:3.0:1788359518.817108:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788359518.817113:0:20328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 28 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359518.817122:0:20328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac7181400, rc 0) 00000100:00100000:3.0:1788359518.817201:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c693dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+28:15673:x1875230420240256:12345-192.168.202.52@tcp:101:dd.0 Request processed in 293us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359518.817208:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 48 00010000:00010000:2.0:1788359519.100682:0:19980:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788359519.420799:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788359519.420811:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359519.420886:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788359519.420900:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788359519.421074:0:17225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17225:1875230445468928:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788359519.421188:0:17225:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0ead289cd80 going to sleep for 11 seconds 00000040:00080000:2.0:1788359519.421231:0:17948:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788359519.426164:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.426348:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240384 00000100:00100000:0.0:1788359519.426362:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240384 00000100:00100000:0.0:1788359519.426476:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00100000:0.0:1788359519.426490:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420240384:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788359519.426592:0:17190:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788359519.426781:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420240384:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 295us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.426790:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 49 00000100:00080000:2.0:1788359519.427229:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788359519.427333:0:17225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17225:1875230445468928:192.168.202.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788359519.432917:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.438129:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240512 00000100:00100000:0.0:1788359519.438153:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240512 00000100:00100000:0.0:1788359519.438379:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:0.0:1788359519.438395:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+28:15674:x1875230420240512:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.438524:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.438548:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.438564:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440598:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440626:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440641:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440678:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440688:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440711:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359519.440775:0:18578:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788359519.440780:0:18578:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788359519.440803:0:18578:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440816:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440823:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440831:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440837:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.440842:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440850:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440878:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eb020dd000) 00010000:00010000:0.0:1788359519.440881:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359519.440887:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440894:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8e00/0x49dd053b5feafd12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440926:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440933:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440939:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440944:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.440953:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440960:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440968:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa0eacd774f00) 00010000:00010000:0.0:1788359519.440970:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359519.440973:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440979:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9600/0x49dd053b5feafd19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.440995:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441001:0:18578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441007:0:18578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441018:0:18578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.441022:0:18578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441027:0:18578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441036:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:0.0:1788359519.441038:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359519.441041:0:18578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.441046:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8800/0x49dd053b5feafd20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.441151:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+28:15674:x1875230420240512:12345-192.168.202.52@tcp:34:lhsmtool_posix.0 Request processed in 2755us (8245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.441161:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 50 00000100:00100000:3.0:1788359519.451833:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.451912:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240768 00000100:00100000:0.0:1788359519.451925:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240768 00000100:00100000:0.0:1788359519.451985:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:0.0:1788359519.451992:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+28:15674:x1875230420240768:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.452011:0:20328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359519.452030:0:20328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafd27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73af expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452120:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452153:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452165:0:20328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788359519.452179:0:20328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788359519.452251:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452256:0:20328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452260:0:20328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452264:0:20328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e2a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.452266:0:20328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452271:0:20328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452279:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:0.0:1788359519.452281:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788359519.452283:0:20328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452287:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452316:0:20328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafd27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73af expref: 30 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452329:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0eb020dd000) 00010000:00010000:0.0:1788359519.452332:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788359519.452336:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9c00/0x49dd053b5feafd27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73af expref: 30 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.452345:0:20328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eac91c9c00, rc 0) 00000100:00100000:0.0:1788359519.452411:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420240768:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 420us (595us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788359519.452418:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 51 00000100:00100000:2.0:1788359519.458739:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.458851:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420240896 00000100:00100000:0.0:1788359519.458875:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420240896 00000100:00100000:0.0:1788359519.458967:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:0.0:1788359519.458977:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420240896:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788359519.459015:0:17190:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788359519.459144:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420240896:12345-192.168.202.52@tcp:53:lhsmtool_posix.0 Request processed in 167us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.459152:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 52 00000100:00100000:3.0:1788359519.478158:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.478249:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420241152 00000100:00100000:0.0:1788359519.478263:0:18578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420241152 00000100:00100000:0.0:1788359519.478342:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:0.0:1788359519.478350:0:18578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+29:15674:x1875230420241152:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.478368:0:18578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359519.478385:0:18578:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73b6 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788359519.478830:0:18578:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1788359519.478836:0:18578:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788359519.478846:0:18578:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788359519.479164:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3a00/0x49dd053b5feafd43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.479177:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3a00/0x49dd053b5feafd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.479188:0:18578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3a00/0x49dd053b5feafd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.479239:0:18578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73b6 expref: 32 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.479254:0:18578:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3a00/0x49dd053b5feafd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73b6 expref: 31 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.479262:0:18578:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774f00) 00010000:00010000:0.0:1788359519.479265:0:18578:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788359519.479269:0:18578:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ead07e3a00, rc 0) 00000100:00100000:0.0:1788359519.479367:0:18578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74da3620-4733-4f31-913b-e0b808f61386+31:15674:x1875230420241152:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 1017us (1226us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788359519.479373:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 53 00000100:00100000:2.0:1788359519.485374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.485522:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420241408 00000100:00100000:0.0:1788359519.485670:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420241408 00000100:00100000:0.0:1788359519.485728:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:0.0:1788359519.485738:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+31:15674:x1875230420241408:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.485810:0:20328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359519.485838:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3a00/0x49dd053b5feafd43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73b6 expref: 31 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.485862:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774f00) 00010000:00010000:0.0:1788359519.486691:0:20328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788359519.486728:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486744:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486755:0:20328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486768:0:20328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486775:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486781:0:20328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486826:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486834:0:20328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486840:0:20328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486854:0:20328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3000 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.486859:0:20328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486886:0:20328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486897:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:0.0:1788359519.486900:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359519.486904:0:20328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486909:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3000/0x49dd053b5feafd51 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486918:0:20328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486924:0:20328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486930:0:20328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486935:0:20328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:0.0:1788359519.486938:0:20328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486945:0:20328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486964:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf6e30150 (ffffa0eacd774300) 00010000:00010000:0.0:1788359519.486967:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788359519.486970:0:20328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.486976:0:20328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e3200/0x49dd053b5feafd58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf6e30150 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.487063:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c803f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+30:15674:x1875230420241408:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 1325us (1697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788359519.487071:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 54 00000100:00100000:2.0:1788359519.493848:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.493914:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420241536 00000100:00100000:0.0:1788359519.493924:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420241536 00000100:00100000:0.0:1788359519.494098:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:0.0:1788359519.494110:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+30:15674:x1875230420241536:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.494130:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359519.494154:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73bd expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494191:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2c00/0x49dd053b5feafd66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494206:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2c00/0x49dd053b5feafd66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494217:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2c00/0x49dd053b5feafd66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494339:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73bd expref: 32 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494362:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2c00/0x49dd053b5feafd66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73bd expref: 31 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.494383:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:0.0:1788359519.494386:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788359519.494389:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ead07e2c00, rc 0) 00000100:00100000:0.0:1788359519.494448:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+31:15674:x1875230420241536:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 340us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.494456:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 55 00000100:00100000:3.0:1788359519.496674:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.496804:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420241792 00000100:00100000:2.0:1788359519.496814:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420241792 00000100:00100000:2.0:1788359519.496872:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:2.0:1788359519.496882:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+31:15674:x1875230420241792:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359519.496958:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.496974:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.496986:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788359519.497149:0:17191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788359519.497157:0:17191:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551467661912ns, next at 552467659937ns, rc = 0 00000004:00010000:2.0:1788359519.497203:0:17191:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092a7dd29 reply state 00000000821693c3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.497214:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.497221:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.497223:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788359519.497226:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359519.497960:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+33:15674:x1875230420241792:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 1075us (1289us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788359519.497968:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 56 00000100:00100000:2.0:1788359519.511147:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.511259:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420241920 00000100:00100000:0.0:1788359519.511269:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420241920 00000100:00100000:0.0:1788359519.511360:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:0.0:1788359519.511371:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+33:15674:x1875230420241920:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788359519.511398:0:20328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788359519.511418:0:20328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73c4 expref: -99 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.511479:0:20328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 34 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.511539:0:20328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 34 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.511560:0:20328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:0.0:1788359519.511563:0:20328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788359519.511573:0:20328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0ead07e2a00, rc 0) 00000100:00100000:0.0:1788359519.511628:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+34:15674:x1875230420241920:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 260us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.511635:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 57 00000100:00100000:3.0:1788359519.522215:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.523661:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420242048 00000100:00100000:2.0:1788359519.523676:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420242048 00000100:00100000:2.0:1788359519.523770:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00100000:2.0:1788359519.523782:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+5:2405:x1875230420242048:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788359519.524051:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+6:2405:x1875230420242048:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 272us (1848us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788359519.524059:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 24 00000100:00080000:0.0:1788359519.524296:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359519.535552:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.535675:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420242304 00000100:00100000:1.0:1788359519.535696:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420242304 00000100:00100000:1.0:1788359519.535825:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:1.0:1788359519.535836:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+34:15674:x1875230420242304:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788359519.536081:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+35:15674:x1875230420242304:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 246us (599us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788359519.536088:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 9 00000100:00100000:3.0:1788359519.540092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.545970:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420242560 00000100:00100000:0.0:1788359519.546006:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420242560 00000100:00100000:2.0:1788359519.546537:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:2.0:1788359519.546553:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+35:15674:x1875230420242560:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788359519.547097:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+35:15674:x1875230420242560:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 546us (7018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.547107:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 58 00000100:00100000:3.0:1788359519.550685:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.551444:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420242688 00000100:00100000:2.0:1788359519.551459:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420242688 00000100:00100000:2.0:1788359519.551714:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:2.0:1788359519.551727:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+35:15674:x1875230420242688:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788359519.551754:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359519.551781:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73cb expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.551911:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.551930:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.551944:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788359519.552011:0:17191:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788359519.552036:0:17191:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.552068:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73cb expref: 37 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.552089:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73cb expref: 36 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.552099:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.552103:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788359519.552107:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c9400, rc 0) 00000100:00100000:2.0:1788359519.552191:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+36:15674:x1875230420242688:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 468us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.552198:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 59 00000100:00100000:3.0:1788359519.556639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.556678:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420242816 00000100:00100000:1.0:1788359519.556696:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420242816 00000100:00100000:1.0:1788359519.556832:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:1.0:1788359519.556845:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+6:2404:x1875230420242816:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788359519.556886:0:18696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788359519.556909:0:18696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73d2 expref: -99 pid: 18696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788359519.556936:0:18696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a98335f, blocks: 0x0 00010000:00010000:1.0:1788359519.556961:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788359519.556967:0:18696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359519.556978:0:18696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 7 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.557003:0:18696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 7 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.557022:0:18696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0e9c75eba00, rc 0) 00000100:00100000:1.0:1788359519.557113:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+7:2404:x1875230420242816:12345-192.168.202.52@tcp:101:lhsmtool_posix.0 Request processed in 272us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359519.557119:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 25 00000100:00100000:3.0:1788359519.567789:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.567910:0:20328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243072 00000100:00100000:0.0:1788359519.567929:0:20328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243072 00000100:00100000:0.0:1788359519.568029:0:20328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:0.0:1788359519.568042:0:20328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+36:15674:x1875230420243072:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788359519.568231:0:20328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:74da3620-4733-4f31-913b-e0b808f61386+36:15674:x1875230420243072:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 192us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788359519.568240:0:20328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 60 00000100:00100000:2.0:1788359519.580759:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.580851:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243200 00000100:00100000:1.0:1788359519.580861:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243200 00000100:00100000:1.0:1788359519.580974:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:1.0:1788359519.580985:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+36:15674:x1875230420243200:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788359519.586291:0:17169:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788359519.586308:0:17169:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788359519.586365:0:17169:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788359519.586560:0:3629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586572:0:3629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586580:0:3629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586586:0:3629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:3.0:1788359519.586590:0:3629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586598:0:3629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586614:0:3629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:3.0:1788359519.586617:0:3629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788359519.586623:0:3629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.586629:0:3629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9e00/0x49dd053b5feafc16 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.586889:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445469056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788359519.586962:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359519.586972:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+19:15674:x1875230420243200:12345-192.168.202.52@tcp:44:lhsmtool_posix.0 Request processed in 5986us (6219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359519.586983:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 61 00000100:00100000:2.0:1788359519.587562:0:18793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445469056 00000100:00100000:2.0:1788359519.587571:0:18793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445469056 00000100:00100000:2.0:1788359519.587633:0:18793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788359519.587642:0:18793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaec18c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445469056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788359519.587766:0:18793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788359519.587777:0:18793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788359519.587779:0:18793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788359519.587782:0:18793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788359519 -> 1788359519 00002000:00010000:2.0:1788359519.587784:0:18793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788359519.587829:0:18793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaec18c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3643:x1875230445469056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (866us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788359519.587836:0:18793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788359519.587908:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788359519.588028:0:3643:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788359519.588043:0:3643:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0eaffb81c00 x1875230445469056/t8589934596(8589934596) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788359535 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788359519.588055:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0eaffb81c00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788359519.588060:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445469056:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788359519.588520:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588532:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588540:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588546:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c8400 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359519.588551:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588558:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588573:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0eacd774800) 00010000:00010000:1.0:1788359519.588577:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359519.588582:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588588:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c8400/0x49dd053b5feafbc2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588609:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588616:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588622:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588638:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9800 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359519.588642:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588648:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588657:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0eacd774a00) 00010000:00010000:1.0:1788359519.588660:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359519.588663:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588669:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9800/0x49dd053b5feafbc9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588683:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588689:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588695:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588700:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359519.588703:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588709:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588730:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0eb020dd500) 00010000:00010000:1.0:1788359519.588733:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359519.588736:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588741:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9e00/0x49dd053b5feafc71 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588756:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588762:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588767:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588772:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7180e00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359519.588775:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588781:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588789:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:1.0:1788359519.588791:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788359519.588794:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588799:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7180e00/0x49dd053b5feafcf6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588823:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588829:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588835:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588840:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:1.0:1788359519.588860:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588877:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588886:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:1.0:1788359519.588889:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788359519.588892:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.588897:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9200/0x49dd053b5feafd6d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359519.592616:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.592971:0:18796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243328 00000100:00100000:2.0:1788359519.592981:0:18796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243328 00000100:00100000:2.0:1788359519.593034:0:18796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:2.0:1788359519.593045:0:18796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+7:2405:x1875230420243328:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788359519.593199:0:18796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74da3620-4733-4f31-913b-e0b808f61386+7:2405:x1875230420243328:12345-192.168.202.52@tcp:16:lhsmtool_posix.0 Request processed in 155us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.593207:0:18796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 27 00000100:00100000:3.0:1788359519.598719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.598833:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243584 00000100:00100000:2.0:1788359519.598844:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243584 00000100:00100000:2.0:1788359519.598951:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 62 00000100:00100000:2.0:1788359519.598962:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+15:15674:x1875230420243584:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788359519.599023:0:17191:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788359519.599051:0:17191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c9400/0x49dd053b5feafd82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73cb expref: 15 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.599083:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.599086:0:17191:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359519.599112:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd90 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.599126:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.599135:0:17191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788359519.599258:0:17191:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b16aa80 reply state 00000000a5095cfa transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.599271:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8c00/0x49dd053b5feafd90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17191 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.599278:0:17191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.599281:0:17191:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788359519.599283:0:17191:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788359519.599382:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74da3620-4733-4f31-913b-e0b808f61386+16:15674:x1875230420243584:12345-192.168.202.52@tcp:36:lhsmtool_posix.0 Request processed in 423us (673us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788359519.599387:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 62 00000100:00100000:0.0:1788359519.601975:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.602131:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243712 00000100:00100000:1.0:1788359519.602141:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243712 00000100:00100000:1.0:1788359519.602202:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:1.0:1788359519.602212:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+7:2404:x1875230420243712:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788359519.602361:0:18696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788359519.602365:0:18696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788359518 00002000:00010000:1.0:1788359519.602378:0:18696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788359518 00002000:00010000:1.0:1788359519.602381:0:18696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788359519 -> 1788359518 00002000:00010000:1.0:1788359519.602383:0:18696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788359519.602442:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74da3620-4733-4f31-913b-e0b808f61386+8:2404:x1875230420243712:12345-192.168.202.52@tcp:2:lhsmtool_posix.0 Request processed in 231us (472us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788359519.602450:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 28 00000100:00100000:3.0:1788359519.605128:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.605620:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420243840 00000100:00100000:2.0:1788359519.605631:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420243840 00000100:00100000:2.0:1788359519.605675:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:2.0:1788359519.605684:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74da3620-4733-4f31-913b-e0b808f61386+8:2404:x1875230420243840:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788359519.605724:0:18695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605753:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359519.605758:0:18695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359519.605765:0:18695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605778:0:18695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605802:0:18695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605810:0:18695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605817:0:18695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605824:0:18695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c9400 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359519.605828:0:18695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605837:0:18695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605851:0:18695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.605876:0:18695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdde72cd/0x49dd053b5feafd97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.605952:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74da3620-4733-4f31-913b-e0b808f61386+8:2404:x1875230420243840:12345-192.168.202.52@tcp:1:lhsmtool_posix.0 Request processed in 269us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.605960:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 29 00000100:00100000:3.0:1788359519.609851:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.609947:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244096 00000100:00100000:2.0:1788359519.609957:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244096 00000100:00100000:2.0:1788359519.610063:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 63 00000100:00100000:2.0:1788359519.610073:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+16:15674:x1875230420244096:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788359519.610166:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.610191:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 16 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.610201:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.610234:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 16 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.610247:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 16 pid: 17190 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.610262:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469184:192.168.202.52@tcp:104: 00000100:00100000:2.0:1788359519.610345:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788359519.615127:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.615330:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469184:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359519.615355:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.615937:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244224 00000100:00100000:0.0:1788359519.615945:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244224 00010000:00010000:0.0:1788359519.615984:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 17 pid: 17190 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.616039:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:0.0:1788359519.616049:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+17:2404:x1875230420244224:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788359519.616064:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788359519.616071:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 17 pid: 17190 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616085:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 17 pid: 17190 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616121:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8800/0x49dd053b5feafcef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e739a expref: 17 pid: 17190 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616136:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:0.0:1788359519.616143:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 16 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616152:0:17176:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616160:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616168:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.616204:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788359519.616240:0:17190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616249:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616457:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616466:0:17190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616478:0:17190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616538:0:17190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.616551:0:17190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359519.616564:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c8074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469312:192.168.202.52@tcp:104: 00000100:00100000:1.0:1788359519.616765:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+17:2404:x1875230420244224:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 715us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359519.616775:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0e9c6baa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788359519.616776:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 19 00000100:00100000:2.0:1788359519.618648:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c8074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469312:192.168.202.52@tcp:104: 00010000:00010000:2.0:1788359519.618671:0:17190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359519.621058:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359519.621121:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244352 00000100:00100000:3.0:1788359519.621142:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244352 00010000:00010000:3.0:1788359519.621179:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359519.621227:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 20 00000100:00100000:3.0:1788359519.621236:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+17:2405:x1875230420244352:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788359519.621251:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788359519.621258:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621272:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621300:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0ead07e2a00/0x49dd053b5feafd74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73c4 expref: 17 pid: 20328 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621312:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:3.0:1788359519.621316:0:17174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621323:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621328:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788359519.621351:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788359519.621375:0:17190:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.621383:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788359519.621412:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74da3620-4733-4f31-913b-e0b808f61386+16:2405:x1875230420244352:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 177us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359519.621427:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 20 00000001:00080000:2.0:1788359519.621485:0:17190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788359519.622025:0:17190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788359519.622063:0:17190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788359519.622139:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17190:1875230445469440:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788359519.622174:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788359519.622920:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445469440 00000100:00100000:2.0:1788359519.622927:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eaec2e3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788359519.622928:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445469440 00000100:00100000:1.0:1788359519.622984:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788359519.622993:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17190:x1875230445469440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788359519.623099:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17190:x1875230445469440:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359519.623107:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788359519.623158:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17190:1875230445469440:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788359519.623458:0:17190:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788359519.623678:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17190:1875230445469568:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788359519.623712:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359519.623756:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eafd82f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788359519.623782:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445469568 00000100:00100000:0.0:1788359519.623785:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445469568 00000100:00100000:0.0:1788359519.623808:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788359519.623813:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17190:x1875230445469568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788359519.623965:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17190:x1875230445469568:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (252us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788359519.623972:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788359519.624022:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17190:1875230445469568:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788359519.624053:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624073:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624079:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624085:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac7181600 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359519.624089:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624096:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624111:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.624114:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359519.624117:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624136:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181600/0x49dd053b5feafda5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624166:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624171:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624177:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624191:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eac91c9a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359519.624199:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624205:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624213:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359519.624216:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788359519.624222:0:17190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 19 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624232:0:17190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 19 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624239:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 19 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.624260:0:17190:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac7181400/0x49dd053b5feafd0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73a8 expref: 19 pid: 20328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.624270:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469696:192.168.202.52@tcp:105: 00000100:00100000:2.0:1788359519.624327:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eacd44a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788359519.630287:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359519.630373:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244480 00000100:00100000:3.0:1788359519.630383:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244480 00000100:00100000:3.0:1788359519.630444:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:3.0:1788359519.630454:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c55a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+20:15673:x1875230420244480:12345-192.168.202.52@tcp:49:dd.0 00000100:00100000:3.0:1788359519.630601:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c55a3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+20:15673:x1875230420244480:12345-192.168.202.52@tcp:49:dd.0 Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359519.630609:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 10 00000100:00100000:2.0:1788359519.630895:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c74fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17190:1875230445469696:192.168.202.52@tcp:105: 00010000:00010000:2.0:1788359519.630921:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.630931:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eac91c9a00/0x49dd053b5feafd04 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18578 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.630979:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.630992:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631004:0:17190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631013:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631019:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631026:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631032:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8200 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359519.631036:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631042:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631059:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359519.631062:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788359519.631065:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631070:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8200/0x49dd053b5feafdac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631088:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631094:0:17190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631100:0:17190:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631106:0:17190:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8a00 already unused, calling callback (ffffffffc17354f0) 00010000:00010000:2.0:1788359519.631109:0:17190:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631115:0:17190:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631123:0:17190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359519.631125:0:17190:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359519.631128:0:17190:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.631134:0:17190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8a00/0x49dd053b5feafd9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17190 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.631263:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74da3620-4733-4f31-913b-e0b808f61386+19:15674:x1875230420244096:12345-192.168.202.52@tcp:57:lhsmtool_posix.0 Request processed in 21191us (21425us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788359519.631272:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 63 00000020:00080000:2.0:1788359519.631276:0:17190:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788359519.631417:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788359519.631422:0:17225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788359519.631439:0:17225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788359519.631446:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788359519.633949:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:2.0:1788359519.634008:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244608 00000100:00100000:2.0:1788359519.634024:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244608 00000100:00100000:2.0:1788359519.634086:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:2.0:1788359519.634095:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+19:15673:x1875230420244608:12345-192.168.202.52@tcp:101:dd.0 00010000:00010000:2.0:1788359519.634115:0:17189:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788359519.634135:0:17189:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafdb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9966a6e7eb3e73d9 expref: -99 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634168:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafdba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634182:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafdba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634192:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafdba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634292:0:17189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8400/0x49dd053b5feafdb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d9 expref: 21 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634310:0:17189:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0eaec5c8600/0x49dd053b5feafdba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d9 expref: 20 pid: 17189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.634318:0:17189:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0eb020dd300) 00010000:00010000:2.0:1788359519.634321:0:17189:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788359519.634325:0:17189:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0eaec5c8600, rc 0) 00000100:00100000:2.0:1788359519.634385:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74da3620-4733-4f31-913b-e0b808f61386+20:15673:x1875230420244608:12345-192.168.202.52@tcp:101:dd.0 Request processed in 291us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.634393:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 64 00000100:00100000:3.0:1788359519.635819:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.635903:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244864 00000100:00100000:1.0:1788359519.635910:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244864 00000100:00100000:1.0:1788359519.635990:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 11 00000100:00100000:1.0:1788359519.636000:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+20:15674:x1875230420244864:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788359519.636259:0:17192:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788359519.636290:0:17192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788359519.636323:0:17192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636337:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636348:0:17192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636356:0:17192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636371:0:17192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636378:0:17192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.636401:0:17192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788359519.636470:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74da3620-4733-4f31-913b-e0b808f61386+22:15674:x1875230420244864:12345-192.168.202.52@tcp:35:lhsmtool_posix.0 Request processed in 471us (657us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788359519.636477:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 11 00000020:00080000:1.0:1788359519.636481:0:17192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788359519.636648:0:17177:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788359519.636655:0:17177:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.636669:0:17177:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0e9c75ea600 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359519.636673:0:17177:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.636680:0:17177:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.636691:0:17177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0eacd774e00) 00010000:00010000:2.0:1788359519.636694:0:17177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788359519.636697:0:17177:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.636703:0:17177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0e9c75ea600/0x49dd053b5feafdc1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.636713:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359519.636715:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788359519.636717:0:17177:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359519.741075:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:3.0:1788359519.741122:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:0.0:1788359519.741331:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420245120 00000100:00100000:0.0:1788359519.741341:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420245120 00000100:00100000:0.0:1788359519.741401:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420244992 00000100:00100000:0.0:1788359519.741404:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420244992 00000100:00100000:0.0:1788359519.741437:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:0.0:1788359519.741578:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74da3620-4733-4f31-913b-e0b808f61386+9:2404:x1875230420245120:12345-192.168.202.52@tcp:4:dd.0 00010000:00010000:0.0:1788359519.741610:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.741641:0:18702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 9 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.741649:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359519.741654:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788359519.741659:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.741693:0:18702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 9 pid: 18696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.741707:0:18702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 9 pid: 18696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.741721:0:18702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18702:1875230445469824:192.168.202.52@tcp:104: 00000100:00100000:0.0:1788359519.741798:0:18702:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0eac984d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788359519.749672:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.52@tcp (source: 12345-192.168.202.52@tcp) 00000100:00100000:1.0:1788359519.749900:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230420245248 00000100:00100000:1.0:1788359519.749913:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230420245248 00010000:00010000:1.0:1788359519.749976:0:17176:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 10 pid: 18696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788359519.750025:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 21 00000100:00100000:1.0:1788359519.750052:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+10:2404:x1875230420245248:12345-192.168.202.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788359519.750072:0:17176:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788359519.750102:0:17176:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 10 pid: 18696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.750118:0:17176:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 10 pid: 18696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.750149:0:17176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359519.750154:0:17176:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788359519.750160:0:17176:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.750172:0:17176:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788359519.750198:0:17176:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788359519.750312:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74da3620-4733-4f31-913b-e0b808f61386+10:2404:x1875230420245248:12345-192.168.202.52@tcp:103:ldlm_bl.0 Request processed in 261us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359519.750320:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 21 00010000:00010000:0.0:1788359519.750821:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07c48fd/0x49dd053b5feafd89 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.52@tcp remote: 0x9966a6e7eb3e73d2 expref: 9 pid: 18696 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788359519.750849:0:18702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18702:1875230445469824:192.168.202.52@tcp:104: 00010000:00010000:0.0:1788359519.751268:0:18702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.751281:0:18702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788359519.751289:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359519.799760:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788359519.799778:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788359519.801247:0:18702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788359519.801252:0:18702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788359518 -> 1788359519 00002000:00010000:2.0:1788359519.801254:0:18702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788359518 -> 1788359519 00002000:00010000:2.0:1788359519.801256:0:18702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788359519.801269:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801279:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801285:0:18702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801302:0:18702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0ead07e3a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359519.801305:0:18702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801311:0:18702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801325:0:18702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801330:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d792f3/0x49dd053b5feafdc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.801484:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c8074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74da3620-4733-4f31-913b-e0b808f61386+6:2404:x1875230420245120:12345-192.168.202.52@tcp:4:dd.0 Request processed in 60036us (60414us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788359519.801532:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 0 00000100:00100000:2.0:1788359519.801568:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:2.0:1788359519.801578:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2404:x1875230420244992:12345-192.168.202.52@tcp:4:dd.0 00002000:00010000:2.0:1788359519.801614:0:18702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a98335f, atime: 0x6a98335e, ctime: 0x6a98335f, blocks: 0x1a68 00010000:00010000:2.0:1788359519.801621:0:18702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801630:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:2.0:1788359519.801634:0:18702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788359519.801647:0:18702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.801658:0:18702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788359519.831804:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788359519.832183:0:18702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788359519.832207:0:18702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832221:0:18702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832231:0:18702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832238:0:18702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0eaec5c8a00 already unused, calling callback (ffffffffc0b29300) 00010000:00010000:2.0:1788359519.832243:0:18702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832252:0:18702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832273:0:18702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788359519.832280:0:18702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf5d632/0x49dd053b5feafdcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788359519.832619:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0ead27ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:74da3620-4733-4f31-913b-e0b808f61386+5:2404:x1875230420244992:12345-192.168.202.52@tcp:4:dd.0 Request processed in 31038us (91490us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788359519.832632:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.52@tcp, seq: 1 00000100:00100000:0.0:1788359519.935147:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445469952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788359519.935233:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788359519.935375:0:18700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445469952 00000100:00100000:2.0:1788359519.935387:0:18700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445469952 00000100:00100000:2.0:1788359519.935485:0:18700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788359519.935514:0:18700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaffb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445469952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788359519.935563:0:18700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788359519.935715:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788359519.938146:0:18700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaffb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875230445469952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2646us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788359519.938159:0:18700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788359519.938255:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3644:1875230445469952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788359520.124677:0:19981:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788359520.444895:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788359520.444976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359520.445138:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470080 00000100:00100000:3.0:1788359520.445150:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470080 00000100:00100000:3.0:1788359520.445226:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359520.445238:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788359520.445285:0:17929:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788359520.445389:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c74fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359520.445397:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788359520.445429:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470080:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788359520.780328:0:20365:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788359521.148663:0:17178:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788359521.471597:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471675:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471714:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445470848:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471738:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471757:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445471360:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471781:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471800:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0e9c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445471872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359521.471823:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471863:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788359521.471870:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445470208:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471899:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471924:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471963:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445471232:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.471980:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.471994:0:3643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445471744:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472014:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472060:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471872 00000100:00100000:3.0:1788359521.472066:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471872 00000100:00100000:3.0:1788359521.472129:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359521.472138:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445471872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788359521.472165:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788359521.472210:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445471872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.472232:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788359521.472251:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359521.472286:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0e9c7799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445471872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788359521.472322:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470336 00000100:00100000:3.0:1788359521.472326:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470336 00000100:00100000:3.0:1788359521.472349:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470848 00000100:00100000:3.0:1788359521.472352:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470848 00000100:00100000:3.0:1788359521.472365:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359521.472371:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445470336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472409:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c7799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875230445470336:12345-0@lo:400:kworker.0 Request processed in 38us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.472416:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359521.472427:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359521.472433:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445470848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472460:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875230445470848:12345-0@lo:400:kworker.0 Request processed in 28us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.472466:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359521.472483:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472551:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445471104:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472588:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445471616:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472613:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472629:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788359521.472635:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472679:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472715:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaffb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472745:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359521.472765:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788359521.472799:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470592 00000100:00100000:3.0:1788359521.472803:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470592 00000100:00100000:3.0:1788359521.472832:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471104 00000100:00100000:3.0:1788359521.472835:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471104 00000100:00100000:3.0:1788359521.472858:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470464 00000100:00100000:3.0:1788359521.472861:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470464 00000100:00100000:3.0:1788359521.472877:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470976 00000100:00100000:3.0:1788359521.472879:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470976 00000100:00100000:3.0:1788359521.472893:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359521.472899:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472937:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470592:12345-0@lo:400:kworker.0 Request processed in 38us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.472944:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788359521.472956:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359521.472961:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445471104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.472988:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445471104:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.472994:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788359521.473014:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359521.473019:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473055:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445470464:12345-0@lo:400:kworker.0 Request processed in 35us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473061:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359521.473073:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788359521.473079:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445470976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473103:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875230445470976:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473109:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788359521.473123:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788359521.473126:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788359521.473132:0:18699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445472000 00000100:00100000:3.0:1788359521.473135:0:18699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445472000 00000100:00100000:3.0:1788359521.473150:0:18699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359521.473155:0:18699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445472000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788359521.473165:0:18699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788359521.473190:0:18699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875230445472000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473196:0:18699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788359521.473224:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473235:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445470976:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473242:0:3645:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788359521.473247:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0eaffb81c00, transno 8589934596 00000004:00080000:3.0:1788359521.473255:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788359521.473274:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaece0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788359521.473285:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3645:1875230445470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473305:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3645:1875230445471104:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473335:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3643:1875230445470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473344:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3643:1875230445470848:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473371:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471360 00000100:00100000:3.0:1788359521.473374:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471360 00000100:00100000:3.0:1788359521.473398:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470720 00000100:00100000:3.0:1788359521.473400:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470720 00000100:00100000:3.0:1788359521.473409:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471232 00000100:00100000:3.0:1788359521.473412:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471232 00000100:00100000:3.0:1788359521.473420:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471744 00000100:00100000:3.0:1788359521.473422:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471744 00000100:00100000:3.0:1788359521.473432:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471616 00000100:00100000:3.0:1788359521.473434:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471616 00000100:00100000:3.0:1788359521.473445:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445471488 00000100:00100000:3.0:1788359521.473447:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445471488 00000100:00100000:3.0:1788359521.473460:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359521.473465:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445471360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473522:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0e9c779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875230445471360:12345-0@lo:400:kworker.0 Request processed in 56us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473528:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788359521.473542:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788359521.473548:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445470720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473577:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875230445470720:12345-0@lo:400:kworker.0 Request processed in 30us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473583:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788359521.473596:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788359521.473602:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445471232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473638:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875230445471232:12345-0@lo:400:kworker.0 Request processed in 36us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473644:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788359521.473658:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359521.473663:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445471744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473690:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875230445471744:12345-0@lo:400:kworker.0 Request processed in 27us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473695:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788359521.473707:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359521.473712:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445471616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473743:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875230445471616:12345-0@lo:400:kworker.0 Request processed in 31us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473749:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788359521.473761:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788359521.473767:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaece0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473794:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaece0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875230445471488:12345-0@lo:400:kworker.0 Request processed in 27us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788359521.473799:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788359521.473819:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788359521.473822:0:17185:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788359521.473840:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb8c700 x1875230445471488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359521.473864:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3645:1875230445471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473875:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3645:1875230445471616:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473915:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875230445470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473925:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875230445471232:0@lo:400:kworker.0 00010000:00080000:3.0:1788359521.473936:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffffa0eaffb65180 x1875230445471744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788359537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788359521.473945:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3643:1875230445471744:0@lo:400:kworker.0 00000100:00100000:3.0:1788359521.473954:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3643:1875230445471360:0@lo:400:kworker.0 00000100:00100000:1.0:1788359521.474153:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875230445470208 00000100:00100000:1.0:1788359521.474158:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875230445470208 00000100:00100000:1.0:1788359521.474195:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788359521.474202:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3643:x1875230445470208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788359521.474241:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0eaf250e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:caaeac2e-9afd-44da-91ff-e628fee28e20+24:3643:x1875230445470208:12345-0@lo:400:kworker.0 Request processed in 39us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788359521.474256:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788359521.474391:0:3643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0eaffb8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:caaeac2e-9afd-44da-91ff-e628fee28e20:3643:1875230445470208:0@lo:400:kworker.0 Debug log: 40919 lines, 40919 kept, 0 dropped, 0 bad.